00000001:02000400:0.0F:1788178872.136780:0:2962:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1788178890.071514:0:3182:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1788178891.977759:0:3245:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 743 MB/s 00000001:01000000:2.0:1788178892.227417:0:3245:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 607 MB/s 00000001:01000000:2.0:1788178892.477836:0:3245:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4579 MB/s 00000020:02000000:3.0:1788178893.347045:0:3274:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.55_27_gdd19d92 00000400:02000000:1.0F:1788178894.360260:0:3289:0:(api-ni.c:2815:lnet_startup_lndni()) Added LNI 192.168.202.102@tcp [8/256/0/180] 00008000:02000000:3.0:1788178898.806447:0:3439:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788178945.513262:0:5244:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788178952.395968:0:5777:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788178952.395975:0:5777:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788178952.396123:0:5777:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 0000000039eb869e 00000080:02000400:2.0:1788178952.396134:0:5777:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788178952.400463:0:5777:0:(tgt_mount.c:2577:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788178952.400487:0:5777:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788178952.400535:0:5777:0:(genops.c:414:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000010893941) 00000020:00000080:2.0:1788178952.400556:0:5777:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788178952.418001:0:5777:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788178952.418764:0:5777:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788178952.440714:0:5777:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788178952.440757:0:5777:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788178952.440779:0:5777:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788178952.440827:0:5777:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788178952.440877:0:5777:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788178952.441238:0:5777:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788178952.441246:0:5777:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788178952.441257:0:5777:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa4c98508c4986d6 00000020:01000004:3.0:1788178952.441264:0:5777:0:(tgt_mount.c:2662:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788178952.441269:0:5777:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788178952.441274:0:5777:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000039eb869e from MGS 00000020:01000004:3.0:1788178952.441279:0:5777:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788178952.441376:0:5777:0:(genops.c:414:class_newdev()) Allocate new device MGS (0000000014f5353f) 00000020:00000080:3.0:1788178952.441390:0:5777:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788178952.441512:0:5777:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000039eb869e from MGS, refs=2 00080000:01000000:3.0:1788178952.441517:0:5777:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788178952.441522:0:5777:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa4c98508c4986e4 00000100:00100000:3.0:1788178952.441736:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788178952.441971:0:5777:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788178952.441979:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788178952.442555:0:5777:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788178952.442623:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788178952.443365:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788178952.443521:0:5777:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788178952.443526:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788178952.444205:0:5777:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788178952.444212:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788178952.444814:0:5777:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788178952.444820:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788178952.445430:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788178952.445434:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788178952.445436:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788178952.445804:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788178952.445806:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788178952.445808:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788178952.446526:0:5777:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788178952.449463:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788178952.695931:0:5777:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4887 MB/s 00000001:01000000:2.0:1788178952.945907:0:5777:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 6831 MB/s 00000001:01000000:0.0:1788178953.196121:0:5777:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 987 MB/s 00000001:01000000:3.0:1788178953.446579:0:5777:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 551 MB/s 00080000:10000000:3.0:1788178953.458830:0:5777:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:1.0:1788178953.472807:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788178953.500554:0:5777:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788178953.500572:0:5777:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788178953.500575:0:5777:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788178953.503613:0:5787:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788178953.503772:0:5777:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788178953.503824:0:5777:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788178953.504100:0:5777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788178953.504126:0:5777:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788178953.505736:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788178953.505913:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788178953.505920:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788178953.510428:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788178953.513719:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788178953.517690:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788178953.517708:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788178953.520840:0:5777:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788178953.520901:0:5777:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.102@tcp' 00000020:01000004:0.0:1788178953.520904:0:5777:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788178953.520953:0:5777:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.102@tcp (typ=mgc) 00000020:00000080:0.0:1788178953.520974:0:5777:0:(genops.c:414:class_newdev()) Allocate new device MGC192.168.202.102@tcp (00000000a5d20ca0) 00000020:00000080:0.0:1788178953.520993:0:5777:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788178953.521133:0:5777:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009b9f1536@MGC192.168.202.102@tcp: add connection 192.168.202.102@tcp at head 00010000:00010000:0.0:1788178953.521314:0:5777:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.102@tcp-0 is initialized 00000040:01000000:0.0:1788178953.521321:0:5777:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.102@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788178953.522370:0:5792:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788178953.530996:0:5793:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788178953.531111:0:5777:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.102@tcp (uuid efc6f743-3303-46d5-8807-513b82cac1cc) 00000020:00000080:2.0:1788178953.531138:0:5777:0:(genops.c:1407:class_connect()) connect: client efc6f743-3303-46d5-8807-513b82cac1cc, cookie 0xaa4c98508c4986f2 00000100:00080000:2.0:1788178953.531152:0:5777:0:(import.c:510:import_select_connection()) MGC192.168.202.102@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788178953.531158:0:5777:0:(import.c:624:import_select_connection()) MGC192.168.202.102@tcp: import 000000009b9f1536 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:2.0:1788178953.531210:0:5777:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f95b805d x1875041471955072/t0(0) o250->MGC192.168.202.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788178953.531239:0:5777:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import efc6f743-3303-46d5-8807-513b82cac1cc->MGS 00000020:01000004:2.0:1788178953.531268:0:5777:0:(tgt_mount.c:1875:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788178953.531292:0:5777:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788178953.531307:0:5777:0:(genops.c:414:class_newdev()) Allocate new device MDS (000000006a6b011f) 00000020:00000080:2.0:1788178953.531322:0:5777:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788178953.532521:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f95b805d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:efc6f743-3303-46d5-8807-513b82cac1cc:3304:1875041471955072:0@lo:250: 00000100:00100000:3.0:1788178953.532743:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788178953.533770:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471955072 00000100:00100000:2.0:1788178953.533782:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471955072 00000100:00100000:2.0:1788178953.533821:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788178953.533828:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db4657eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1875041471955072:12345-0@lo:250: 00010000:00080000:2.0:1788178953.533869:0:5789:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from efc6f743-3303-46d5-8807-513b82cac1cc@0@lo t0 exp 0000000000000000 cur 149 last 0 00000020:00000080:2.0:1788178953.533910:0:5789:0:(genops.c:1407:class_connect()) connect: client efc6f743-3303-46d5-8807-513b82cac1cc, cookie 0xaa4c98508c498700 00000100:00080000:2.0:1788178953.534052:0:5789:0:(import.c:65:import_set_state_nolock()) 0000000076743c19 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788178953.534122:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db4657eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+5:3304:x1875041471955072:12345-0@lo:250: Request processed in 293us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788178953.534130:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788178953.534179:0:3304:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.102@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788178953.534189:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.102@tcp: connect to target with instance 0 00000100:00080000:2.0:1788178953.534196:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.102@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788178953.534200:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788178953.534202:0:3304:0:(import.c:65:import_set_state_nolock()) 000000009b9f1536 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788178953.534205:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788178953.534214:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788178953.534219:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f95b805d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:efc6f743-3303-46d5-8807-513b82cac1cc:3304:1875041471955072:0@lo:250: 00000100:00100000:2.0:1788178953.555254:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788178953.556131:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788178953.556139:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788178953.567536:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788178953.567692:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788178953.568366:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788178953.568373:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788178953.569215:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788178953.569454:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788178953.569461:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788178953.576684:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788178953.576701:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788178953.665267:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788178953.665500:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788178953.665508:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788178953.668312:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788178953.668328:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788178953.669078:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788178953.669210:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788178953.669214:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788178953.670307:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788178953.670315:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788178953.671005:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788178953.671111:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788178953.671114:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788178953.671562:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788178953.671570:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788178953.672749:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788178953.673160:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788178953.673164:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788178953.674000:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788178953.674008:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788178953.704081:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788178953.704481:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788178953.704489:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788178953.705461:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788178953.705470:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788178953.706471:0:5777:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788178953.706480:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788178953.707186:0:5777:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788178953.707208:0:5777:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788178953.707214:0:5777:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.102@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788178953.707338:0:5777:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.102@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788178953.707527:0:5777:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.102@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788178953.707531:0:5777:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788178953.707533:0:5777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788178953.707534:0:5777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788178953.707535:0:5777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788178953.707541:0:5777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788178953.707542:0:5777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788178953.707543:0:5777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788178953.707544:0:5777:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788178953.707546:0:5777:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788178953.707547:0:5777:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788178953.707548:0:5777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788178953.707549:0:5777:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788178953.707551:0:5777:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788178953.707553:0:5777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788178953.707554:0:5777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788178953.707555:0:5777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788178953.707556:0:5777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788178953.707557:0:5777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788178953.707558:0:5777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788178953.707558:0:5777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788178953.707559:0:5777:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788178953.707560:0:5777:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788178953.707561:0:5777:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788178953.707562:0:5777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788178953.707563:0:5777:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788178953.707597:0:5777:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788178953.707614:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000048c00e0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471955200:0@lo:253: 00000100:00100000:1.0:1788178953.708673:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178953.708793:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a38eec0c going to sleep for 11 seconds 00000100:00100000:0.0:1788178953.709018:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471955200 00000100:00100000:0.0:1788178953.709026:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471955200 00000100:00100000:0.0:1788178953.709106:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788178953.709115:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084dc685f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+5:5777:x1875041471955200:12345-0@lo:253: 20000000:01000000:0.0:1788178953.709171:0:5791:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788178953.709174:0:5791:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788178953.709753:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788178953.709999:0:5791:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788178953.710488:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788178953.713197:0:5813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788178953.713578:0:5791:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788178953.713583:0:5791:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788178953.713588:0:5791:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788178953.713590:0:5791:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788178953.713606:0:5791:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788178953.714013:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788178953.714253:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788178953.714265:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788178953.714468:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788178953.714522:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788178953.714556:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788178953.714658:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788178953.714666:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788178953.714712:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788178953.714720:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788178953.714752:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788178953.714760:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788178953.714973:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788178953.715020:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788178953.715047:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788178953.715051:0:5791:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788178953.715061:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788178953.715248:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788178953.715256:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788178953.715345:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788178953.715478:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788178953.715518:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788178953.715527:0:5791:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788178953.715595:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788178953.715603:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788178953.715660:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788178953.715699:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788178953.715744:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788178953.715754:0:5791:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788178953.717585:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788178953.717603:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788178953.717650:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788178953.717687:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788178953.718142:0:5791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788178953.718185:0:5791:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788178953.718193:0:5791:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788178953.718917:0:5814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788178953.719177:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788178953.719199:0:5791:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.102@tcp for mdt 20000000:01000000:2.0:1788178953.719201:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.102@tcp (null) (null) (null) 00000040:00080000:2.0:1788178953.719228:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788178953.719235:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788178953.719258:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788178953.719264:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.102@tcp (null) (null) 00000040:00080000:2.0:1788178953.719462:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788178953.719472:0:5791:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788178953.719501:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788178953.719547:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788178953.719603:0:5791:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788178953.719606:0:5791:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788178953.719609:0:5791:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788178953.719620:0:5791:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788178953.719622:0:5791:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788178953.719660:0:5791:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788178953.719662:0:5791:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788178953.720105:0:5815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788178953.720441:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788178953.720481:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788178953.720508:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1788178953.720517:0:5791:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788178953.720523:0:5791:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788178953.722552:0:5816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1788178953.723005:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788178953.723043:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1788178953.723115:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1788178953.723140:0:5791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788178953.723142:0:5791:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1788178953.723146:0:5791:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788178953.723149:0:5791:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788178953.723154:0:5791:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788178953.723159:0:5791:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788178953.723577:0:5817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1788178953.723701:0:5791:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788178953.730164:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1788178953.730197:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1788178953.730249:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1788178953.730284:0:5791:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788178953.730300:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000075e44a5e/0xaa4c98508c498707 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178953.730315:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000075e44a5e/0xaa4c98508c498707 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178953.730322:0:5791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000075e44a5e/0xaa4c98508c498707 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178953.730326:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000075e44a5e/0xaa4c98508c498707 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178953.730330:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000075e44a5e/0xaa4c98508c498707 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178953.730334:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000075e44a5e/0xaa4c98508c498707 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178953.730337:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000075e44a5e already unused, calling callback (00000000ac167e88) 00010000:00010000:1.0:1788178953.730339:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000075e44a5e/0xaa4c98508c498707 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178953.730344:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000075e44a5e/0xaa4c98508c498707 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178953.730357:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000075e44a5e/0xaa4c98508c498707 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178953.730424:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000075e44a5e/0xaa4c98508c498707 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178953.730428:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000075e44a5e/0xaa4c98508c498707 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788178953.730439:0:5791:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788178953.929110:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084dc685f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+5:5777:x1875041471955200:12345-0@lo:253: Request processed in 219989us (220435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178953.929130:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788178953.929218:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000048c00e0d pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471955200:0@lo:253: 10000000:01000000:0.0:1788178953.929234:0:5777:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788178953.929238:0:5777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788178953.929240:0:5777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788178953.929241:0:5777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788178953.929242:0:5777:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788178953.929244:0:5777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788178953.929245:0:5777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788178953.929246:0:5777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788178953.929248:0:5777:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788178953.929249:0:5777:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788178953.929250:0:5777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788178953.929252:0:5777:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788178953.929269:0:5777:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000039eb869e from lustre-MDT0000 10000000:01000000:0.0:1788178953.929296:0:5777:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788178953.929299:0:5777:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788178953.929303:0:5777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9bc9265819c0 10000000:01000000:0.0:1788178953.929307:0:5777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788178953.929314:0:5777:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9bc9265819c0 from 1 10000000:01000000:0.0:1788178953.929317:0:5777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788178953.929490:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: 0000000035ef7c9c/0xaa4c98508c49870e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178953.929509:0:5777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: 0000000035ef7c9c/0xaa4c98508c49870e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178953.929519:0:5777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: 0000000035ef7c9c/0xaa4c98508c49870e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788178953.929536:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001bd09f86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471955328:0@lo:101: 00000100:00100000:0.0:1788178953.929720:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178953.929816:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 00000000035c4dec going to sleep for 11 seconds 00000100:00100000:2.0:1788178953.929926:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471955328 00000100:00100000:2.0:1788178953.929933:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471955328 00000100:00100000:2.0:1788178953.930010:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788178953.930018:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010d6d3b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+5:5777:x1875041471955328:12345-0@lo:101: 00010000:00010000:2.0:1788178953.930031:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788178953.930045:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000029ddc449/0xaa4c98508c498715 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c49870e expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178953.930065:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000029ddc449/0xaa4c98508c498715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c49870e expref: 6 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178953.930074:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000029ddc449/0xaa4c98508c498715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c49870e expref: 6 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178953.930083:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000029ddc449, rc 0) 00000100:00100000:2.0:1788178953.930121:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010d6d3b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+6:5777:x1875041471955328:12345-0@lo:101: Request processed in 105us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788178953.930127:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788178953.930191:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001bd09f86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471955328:0@lo:101: 00010000:00010000:1.0:1788178953.930204:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: 0000000035ef7c9c/0xaa4c98508c49870e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498715 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178953.930212:0:5777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: 0000000035ef7c9c/0xaa4c98508c49870e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498715 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178953.930257:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003bb27886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471955456:0@lo:501: 00000100:00100000:1.0:1788178953.930294:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178953.930503:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 000000000a1cb083 going to sleep for 11 seconds 00000100:00100000:0.0:1788178953.930650:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471955456 00000100:00100000:0.0:1788178953.930655:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471955456 00000100:00100000:0.0:1788178953.930677:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788178953.930682:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068dbe3de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+6:5777:x1875041471955456:12345-0@lo:501: 00000100:00100000:0.0:1788178953.930929:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068dbe3de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+6:5777:x1875041471955456:12345-0@lo:501: Request processed in 246us (634us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788178953.930936:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788178953.931040:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003bb27886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471955456:0@lo:501: 10000000:01000000:1.0:1788178953.931078:0:5777:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788178953.931096:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: 0000000035ef7c9c/0xaa4c98508c49870e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498715 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178953.931105:0:5777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: 0000000035ef7c9c/0xaa4c98508c49870e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498715 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788178953.931113:0:5777:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bc9070e2800 10000000:01000000:1.0:1788178953.931117:0:5777:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788178953.931127:0:5777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9bc9070e2800 10000000:01000000:1.0:1788178953.931130:0:5777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788178953.931133:0:5777:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9bc9070e2800 from 1 10000000:01000000:1.0:1788178953.931136:0:5777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788178953.931156:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: 0000000075e44a5e/0xaa4c98508c49871c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178953.931162:0:5777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: 0000000075e44a5e/0xaa4c98508c49871c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178953.931169:0:5777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: 0000000075e44a5e/0xaa4c98508c49871c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178953.931181:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003bb27886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471955584:0@lo:101: 00000100:00100000:1.0:1788178953.931206:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178953.931224:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 000000000a1cb083 going to sleep for 11 seconds 00000100:00100000:2.0:1788178953.931283:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471955584 00000100:00100000:2.0:1788178953.931288:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471955584 00000100:00100000:2.0:1788178953.931307:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788178953.931312:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6d6526d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+6:5777:x1875041471955584:12345-0@lo:101: 00010000:00010000:2.0:1788178953.931319:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788178953.931327:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000082c74ad8/0xaa4c98508c498723 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c49871c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178953.931342:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000082c74ad8/0xaa4c98508c498723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c49871c expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178953.931504:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000082c74ad8/0xaa4c98508c498723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c49871c expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178953.931513:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000082c74ad8, rc 0) 00000100:00100000:1.0:1788178953.931632:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003bb27886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471955584:0@lo:101: 00010000:00010000:1.0:1788178953.931653:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: 0000000075e44a5e/0xaa4c98508c49871c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498723 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178953.931660:0:5777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: 0000000075e44a5e/0xaa4c98508c49871c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498723 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788178953.931675:0:5777:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788178953.931678:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: 0000000075e44a5e/0xaa4c98508c49871c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498723 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178953.931683:0:5777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: 0000000075e44a5e/0xaa4c98508c49871c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498723 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788178953.931699:0:5777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788178953.931702:0:5777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788178953.931707:0:5777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9bc9070e2800 10000000:01000000:1.0:1788178953.931709:0:5777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788178953.931712:0:5777:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788178953.931714:0:5777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788178953.931728:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: 00000000b853af22/0xaa4c98508c49872a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178953.931734:0:5777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: 00000000b853af22/0xaa4c98508c49872a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178953.931739:0:5777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: 00000000b853af22/0xaa4c98508c49872a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178953.931749:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003bb27886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471955712:0@lo:101: 00000100:00100000:1.0:1788178953.931923:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178953.931992:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 000000000a1cb083 going to sleep for 11 seconds 00000100:00100000:2.0:1788178953.932056:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6d6526d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+7:5777:x1875041471955584:12345-0@lo:101: Request processed in 743us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788178953.932063:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788178953.932085:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471955712 00000100:00100000:2.0:1788178953.932090:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471955712 00000100:00100000:0.0:1788178953.932176:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788178953.932249:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca2c7367 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+7:5777:x1875041471955712:12345-0@lo:101: 00010000:00010000:3.0:1788178953.932259:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788178953.932270:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000135f2d6a/0xaa4c98508c498731 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c49872a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178953.932285:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000135f2d6a/0xaa4c98508c498731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c49872a expref: 8 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178953.932292:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000135f2d6a/0xaa4c98508c498731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c49872a expref: 8 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178953.932298:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000135f2d6a, rc 0) 00000100:00100000:3.0:1788178953.932335:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca2c7367 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+8:5777:x1875041471955712:12345-0@lo:101: Request processed in 153us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178953.932341:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788178953.932495:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003bb27886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471955712:0@lo:101: 00010000:00010000:1.0:1788178953.932505:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: 00000000b853af22/0xaa4c98508c49872a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498731 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178953.932512:0:5777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: 00000000b853af22/0xaa4c98508c49872a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498731 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178953.932566:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003bb27886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471955840:0@lo:501: 00000100:00100000:1.0:1788178953.932591:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178953.932620:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 000000000a1cb083 going to sleep for 11 seconds 00000100:00100000:0.0:1788178953.932738:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471955840 00000100:00100000:0.0:1788178953.932743:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471955840 00000100:00100000:0.0:1788178953.932761:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788178953.932766:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ccb8b310 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+9:5777:x1875041471955840:12345-0@lo:501: 00000100:00100000:0.0:1788178953.933025:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ccb8b310 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+10:5777:x1875041471955840:12345-0@lo:501: Request processed in 258us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178953.933032:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788178953.933115:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003bb27886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471955840:0@lo:501: 00000100:00100000:1.0:1788178953.933146:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003bb27886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471955968:0@lo:503: 00000100:00100000:1.0:1788178953.933184:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178953.933214:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 000000000a1cb083 going to sleep for 11 seconds 00000100:00100000:0.0:1788178953.933264:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471955968 00000100:00100000:0.0:1788178953.933268:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471955968 00000100:00100000:0.0:1788178953.933284:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788178953.933295:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059ece705 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+10:5777:x1875041471955968:12345-0@lo:503: 00000100:00100000:0.0:1788178953.933451:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059ece705 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+10:5777:x1875041471955968:12345-0@lo:503: Request processed in 156us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178953.933458:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788178953.933685:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003bb27886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471955968:0@lo:503: 00000100:00100000:1.0:1788178953.934082:0:5819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003bb27886 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:5819:1875041471956096:0@lo:502: 00000100:00100000:1.0:1788178953.934118:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178953.934147:0:5819:0:(client.c:2702:ptlrpc_set_wait()) set 00000000eaf23583 going to sleep for 11 seconds 00000100:00100000:0.0:1788178953.934198:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471956096 00000100:00100000:0.0:1788178953.934202:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471956096 00000100:00100000:0.0:1788178953.934234:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788178953.934241:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c22d5ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+9:5819:x1875041471956096:12345-0@lo:502: 00000100:00100000:0.0:1788178953.934497:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c22d5ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+9:5819:x1875041471956096:12345-0@lo:502: Request processed in 257us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178953.934504:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788178953.934693:0:5819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003bb27886 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:5819:1875041471956096:0@lo:502: 00000020:01000000:1.0:1788178953.934716:0:5819:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788178953.934728:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788178953.934731:0:5819:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788178953.934735:0:5819:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788178953.934738:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788178953.934760:0:5819:0:(genops.c:414:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000001eb87df0) 00000020:00000080:1.0:1788178953.934780:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788178953.934786:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788178953.934937:0:5819:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788178953.934946:0:5819:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa4c98508c49873f 00000020:00000080:1.0:1788178953.935181:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788178953.935186:0:5819:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788178953.935189:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788178953.935190:0:5819:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788178953.935193:0:5819:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788178953.935196:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788178953.935197:0:5819:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788178953.935201:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788178953.935206:0:5819:0:(genops.c:414:class_newdev()) Allocate new device lustre-MDT0000 (000000005c656c2f) 00000020:00000080:1.0:1788178953.935220:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788178953.935224:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788178953.935226:0:5819:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788178953.935228:0:5819:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788178953.935234:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788178953.935275:0:5819:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000039eb869e from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788178953.935287:0:5819:0:(genops.c:414:class_newdev()) Allocate new device lustre-MDD0000 (00000000e4755479) 00000020:00000080:1.0:1788178953.935294:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788178953.935506:0:5819:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788178953.935512:0:5819:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa4c98508c498754 00000020:00000080:1.0:1788178953.935695:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788178953.935701:0:5819:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788178953.935705:0:5819:0:(genops.c:1407:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xaa4c98508c49875b 00080000:01000000:1.0:1788178953.935710:0:5819:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788178953.935713:0:5819:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa4c98508c498762 00080000:10000000:1.0:1788178953.936253:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1788178953.936671:0:5819:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1788178953.941707:0:5819:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788178954.028123:0:5819:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788178954.028716:0:5819:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788178954.041089:0:5819:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788178954.043649:0:5819:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788178954.159356:0:5819:0:(genops.c:414:class_newdev()) Allocate new device lustre-QMT0000 (00000000243b9936) 00000020:00000080:0.0:1788178954.159498:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788178954.159996:0:5819:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788178954.160004:0:5819:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa4c98508c498770 00000020:00000080:1.0:1788178954.162054:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788178954.170740:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788178954.249400:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788178954.336459:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788178954.380346:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788178954.435417:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788178954.492141:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00010000:00010000:1.0:1788178954.496281:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788178954.523051:0:5819:0:(genops.c:1407:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xaa4c98508c498777 00000020:00000080:0.0:1788178954.523363:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788178954.523375:0:5819:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788178954.523382:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788178954.523384:0:5819:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788178954.523389:0:5819:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788178954.523393:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788178954.523394:0:5819:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788178954.523397:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788178954.523399:0:5819:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788178954.523402:0:5819:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788178954.523405:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788178954.523406:0:5819:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788178954.523408:0:5819:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788178954.523417:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788178954.523419:0:5819:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788178954.523423:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788178954.523459:0:5819:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1788178954.523511:0:5819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000068190f4c pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:5819:1875041471956224:0@lo:502: 00000100:00100000:0.0:1788178954.523666:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178954.523752:0:5819:0:(client.c:2702:ptlrpc_set_wait()) set 00000000732f8c5e going to sleep for 11 seconds 00000100:00100000:3.0:1788178954.523834:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471956224 00000100:00100000:3.0:1788178954.523840:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471956224 00000100:00100000:3.0:1788178954.523922:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788178954.523930:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000303cd1b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+9:5819:x1875041471956224:12345-0@lo:502: 00000100:00100000:3.0:1788178954.524317:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000303cd1b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+9:5819:x1875041471956224:12345-0@lo:502: Request processed in 387us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178954.524325:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788178954.524414:0:5819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000068190f4c pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:5819:1875041471956224:0@lo:502: 00000020:01000000:1.0:1788178954.524439:0:5819:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788178954.524444:0:5819:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788178954.524445:0:5819:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1788178954.524449:0:5819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788178954.524712:0:5777:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788178954.524731:0:5777:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788178954.524778:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: 00000000b853af22/0xaa4c98508c49872a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498731 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178954.524790:0:5777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: 00000000b853af22/0xaa4c98508c49872a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498731 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788178954.524798:0:5777:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9bc9070e2800 from 1 10000000:01000000:0.0:1788178954.524801:0:5777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788178954.524826:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: 0000000012c5a864/0xaa4c98508c49877e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178954.524833:0:5777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: 0000000012c5a864/0xaa4c98508c49877e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178954.524841:0:5777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: 0000000012c5a864/0xaa4c98508c49877e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788178954.524914:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007adb2b26 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471956352:0@lo:101: 00000100:00100000:0.0:1788178954.524943:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178954.524971:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 000000003df56288 going to sleep for 11 seconds 00000100:00100000:2.0:1788178954.525044:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471956352 00000100:00100000:2.0:1788178954.525048:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471956352 00000100:00100000:0.0:1788178954.525128:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788178954.525143:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e48a8e80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+9:5777:x1875041471956352:12345-0@lo:101: 00010000:00010000:0.0:1788178954.525152:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788178954.525163:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c091e474/0xaa4c98508c498785 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c49877e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178954.525180:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c091e474/0xaa4c98508c498785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c49877e expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178954.525188:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c091e474/0xaa4c98508c498785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c49877e expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178954.525195:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c091e474, rc 0) 00000100:00100000:0.0:1788178954.525217:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e48a8e80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+10:5777:x1875041471956352:12345-0@lo:101: Request processed in 75us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178954.525222:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788178954.525333:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007adb2b26 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471956352:0@lo:101: 00010000:00010000:1.0:1788178954.525344:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: 0000000012c5a864/0xaa4c98508c49877e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498785 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.525352:0:5777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: 0000000012c5a864/0xaa4c98508c49877e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498785 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178954.525961:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003bb27886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471956480:0@lo:256: 00000100:00100000:1.0:1788178954.525998:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178954.526061:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 0000000021fbc37a going to sleep for 11 seconds 00000100:00100000:0.0:1788178954.526287:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471956480 00000100:00100000:0.0:1788178954.526294:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471956480 00000100:00100000:0.0:1788178954.526367:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788178954.526374:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d32d5831 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+10:5777:x1875041471956480:12345-0@lo:256: 20000000:01000000:0.0:1788178954.526390:0:5789:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788178954.526397:0:5789:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788178954.526472:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d32d5831 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+10:5777:x1875041471956480:12345-0@lo:256: Request processed in 100us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178954.526479:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788178954.526535:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003bb27886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471956480:0@lo:256: 10000000:01000000:1.0:1788178954.527109:0:5777:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788178954.527123:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: 0000000012c5a864/0xaa4c98508c49877e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498785 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.527133:0:5777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: 0000000012c5a864/0xaa4c98508c49877e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498785 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788178954.527141:0:5777:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bc9070e2800 from 1 10000000:01000000:1.0:1788178954.527144:0:5777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788178954.527168:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: 00000000993384da/0xaa4c98508c49878c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.527175:0:5777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: 00000000993384da/0xaa4c98508c49878c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.527184:0:5777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: 00000000993384da/0xaa4c98508c49878c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178954.527197:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003bb27886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471956608:0@lo:101: 00000100:00100000:1.0:1788178954.527229:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178954.531130:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 0000000021fbc37a going to sleep for 11 seconds 00000100:00100000:3.0:1788178954.534706:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471956608 00000100:00100000:3.0:1788178954.534727:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471956608 00000100:00100000:3.0:1788178954.534796:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788178954.534805:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b8cf899 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+10:5777:x1875041471956608:12345-0@lo:101: 00010000:00010000:3.0:1788178954.534824:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788178954.534844:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000064c040f3/0xaa4c98508c498793 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c49878c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178954.534890:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000064c040f3/0xaa4c98508c498793 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c49878c expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178954.534902:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000064c040f3/0xaa4c98508c498793 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c49878c expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178954.534911:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000064c040f3, rc 0) 00000100:00100000:3.0:1788178954.535005:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b8cf899 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+11:5777:x1875041471956608:12345-0@lo:101: Request processed in 202us (7776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178954.535013:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788178954.535405:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003bb27886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471956608:0@lo:101: 00010000:00010000:1.0:1788178954.535425:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: 00000000993384da/0xaa4c98508c49878c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498793 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.535452:0:5777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: 00000000993384da/0xaa4c98508c49878c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498793 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178954.535523:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003bb27886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471956736:0@lo:501: 00000100:00100000:1.0:1788178954.535557:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178954.535589:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 0000000021fbc37a going to sleep for 11 seconds 00000100:00100000:3.0:1788178954.535692:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471956736 00000100:00100000:3.0:1788178954.535697:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471956736 00000100:00100000:3.0:1788178954.535721:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788178954.535727:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089ce0213 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+11:5777:x1875041471956736:12345-0@lo:501: 00000100:00100000:3.0:1788178954.536336:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089ce0213 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+11:5777:x1875041471956736:12345-0@lo:501: Request processed in 608us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178954.536343:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788178954.536454:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003bb27886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471956736:0@lo:501: 00000100:00100000:1.0:1788178954.536485:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003bb27886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471956864:0@lo:503: 00000100:00100000:1.0:1788178954.536523:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178954.536551:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 0000000021fbc37a going to sleep for 11 seconds 00000100:00100000:0.0:1788178954.536608:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471956864 00000100:00100000:0.0:1788178954.536614:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471956864 00000100:00100000:0.0:1788178954.536649:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788178954.536656:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f61ff6cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+11:5777:x1875041471956864:12345-0@lo:503: 00000040:00080000:0.0:1788178954.536689:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788178954.536741:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f61ff6cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+11:5777:x1875041471956864:12345-0@lo:503: Request processed in 85us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178954.536747:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788178954.536826:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003bb27886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471956864:0@lo:503: 00000040:00080000:1.0:1788178954.537708:0:5823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788178954.537880:0:5777:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788178954.537896:0:5777:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788178954.537909:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: 00000000993384da/0xaa4c98508c49878c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498793 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178954.537917:0:5777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: 00000000993384da/0xaa4c98508c49878c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498793 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788178954.537948:0:5777:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788178954.537950:0:5777:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bc9070e2800 10000000:01000000:0.0:1788178954.537953:0:5777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bc9070e2800 10000000:01000000:0.0:1788178954.537955:0:5777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788178954.537959:0:5777:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9bc9070e2800 from 1 10000000:01000000:0.0:1788178954.537961:0:5777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788178954.537987:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: 00000000255d30b4/0xaa4c98508c49879a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178954.537992:0:5777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: 00000000255d30b4/0xaa4c98508c49879a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178954.537998:0:5777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: 00000000255d30b4/0xaa4c98508c49879a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788178954.538009:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002912df79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471956992:0@lo:101: 00000100:00100000:0.0:1788178954.538048:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178954.538080:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 000000008acdcf67 going to sleep for 11 seconds 00000100:00100000:1.0:1788178954.538156:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471956992 00000100:00100000:1.0:1788178954.538162:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471956992 00000100:00100000:1.0:1788178954.538190:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788178954.538196:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b93f430f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+11:5777:x1875041471956992:12345-0@lo:101: 00010000:00010000:1.0:1788178954.538206:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788178954.538218:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dd68afeb/0xaa4c98508c4987a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c49879a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.538238:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dd68afeb/0xaa4c98508c4987a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c49879a expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.538248:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dd68afeb/0xaa4c98508c4987a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c49879a expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.538272:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dd68afeb, rc 0) 00000100:00100000:1.0:1788178954.538301:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b93f430f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+12:5777:x1875041471956992:12345-0@lo:101: Request processed in 105us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178954.538308:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788178954.538432:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002912df79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471956992:0@lo:101: 00010000:00010000:0.0:1788178954.538452:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: 00000000255d30b4/0xaa4c98508c49879a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c4987a1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178954.538460:0:5777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: 00000000255d30b4/0xaa4c98508c49879a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c4987a1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788178954.538499:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002912df79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471957120:0@lo:501: 00000100:00100000:0.0:1788178954.538522:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178954.538584:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 000000008acdcf67 going to sleep for 11 seconds 00000100:00100000:2.0:1788178954.539902:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471957120 00000100:00100000:2.0:1788178954.539914:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471957120 00000100:00100000:1.0:1788178954.540115:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788178954.540126:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003af41b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+12:5777:x1875041471957120:12345-0@lo:501: 00000100:00100000:1.0:1788178954.540454:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003af41b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+12:5777:x1875041471957120:12345-0@lo:501: Request processed in 330us (1930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178954.540461:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788178954.540622:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002912df79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471957120:0@lo:501: 00000100:00100000:0.0:1788178954.540674:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002912df79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471957248:0@lo:503: 00000100:00100000:0.0:1788178954.540722:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788178954.540747:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471957248 00000100:00100000:2.0:1788178954.540752:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471957248 00000100:00100000:0.0:1788178954.540765:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 000000008acdcf67 going to sleep for 11 seconds 00000100:00100000:2.0:1788178954.540818:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788178954.540826:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000347bdc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+12:5777:x1875041471957248:12345-0@lo:503: 00000100:00100000:2.0:1788178954.541179:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000347bdc06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+12:5777:x1875041471957248:12345-0@lo:503: Request processed in 354us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788178954.541187:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788178954.541263:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002912df79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471957248:0@lo:503: 00000100:00100000:3.0:1788178954.541765:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d529753d pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:5824:1875041471957376:0@lo:502: 00000100:00100000:3.0:1788178954.541806:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178954.541842:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d1ca5521 going to sleep for 11 seconds 00000100:00100000:0.0:1788178954.541989:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471957376 00000100:00100000:0.0:1788178954.541995:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471957376 00000100:00100000:0.0:1788178954.542023:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788178954.542030:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7583e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+12:5824:x1875041471957376:12345-0@lo:502: 00000100:00100000:0.0:1788178954.542829:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7583e88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+12:5824:x1875041471957376:12345-0@lo:502: Request processed in 796us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178954.542837:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788178954.544311:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d529753d pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:5824:1875041471957376:0@lo:502: 00000020:01000004:3.0:1788178954.544392:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788178954.544406:0:5824:0:(genops.c:414:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000d8544d35) 00000020:00000080:3.0:1788178954.544425:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788178954.544619:0:5824:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000039eb869e from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788178954.544624:0:5824:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000039eb869e from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788178954.544627:0:5824:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000039eb869e 4 00010000:00080000:3.0:1788178954.544672:0:5824:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f02e6d5f@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.102@tcp at head 00010000:00010000:3.0:1788178954.546803:0:5824:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788178954.546931:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788178954.546965:0:5824:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788178954.546980:0:5824:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xaa4c98508c4987af 00000100:00080000:3.0:1788178954.546994:0:5824:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788178954.547000:0:5824:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f02e6d5f using connection 192.168.202.102@tcp/0@lo 00000100:00100000:3.0:1788178954.547056:0:5824:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d529753d x1875041471957504/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788178954.547090:0:5824:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788178954.548500:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d529753d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875041471957504:0@lo:38: 00000100:00100000:0.0:1788178954.548582:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178954.549061:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471957504 00000100:00100000:3.0:1788178954.549071:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471957504 00000100:00100000:3.0:1788178954.549117:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788178954.549124:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002912df79 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875041471957504:12345-0@lo:38: 00000100:00100000:1.0:1788178954.549129:0:5797:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788178954.549138:0:5797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788178954.549186:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002912df79 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875041471957504:12345-0@lo:38: Request processed in 61us (603us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788178954.549195:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788178954.549230:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788178954.549240:0:3304:0:(import.c:65:import_set_state_nolock()) 00000000f02e6d5f lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788178954.549246:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788178954.549251:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d529753d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875041471957504:0@lo:38: 00000100:00100000:0.0:1788178954.549418:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bf9fc061 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:5824:1875041471957632:0@lo:502: 00000100:00100000:0.0:1788178954.549460:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178954.549496:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471957632 00000100:00100000:0.0:1788178954.549498:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set 000000007d5b0b56 going to sleep for 11 seconds 00000100:00100000:1.0:1788178954.549500:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471957632 00000100:00100000:1.0:1788178954.549528:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788178954.549532:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e4d87d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+12:5824:x1875041471957632:12345-0@lo:502: 00000100:00100000:1.0:1788178954.549792:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e4d87d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+12:5824:x1875041471957632:12345-0@lo:502: Request processed in 259us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178954.549800:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788178954.549914:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bf9fc061 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:5824:1875041471957632:0@lo:502: 00000040:00080000:0.0:1788178954.549938:0:5824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788178954.549994:0:5777:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788178954.550019:0:5777:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788178954.550040:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: 00000000255d30b4/0xaa4c98508c49879a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c4987a1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.550059:0:5777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: 00000000255d30b4/0xaa4c98508c49879a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c4987a1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788178954.550106:0:5777:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788178954.550108:0:5777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788178954.550110:0:5777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788178954.550111:0:5777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788178954.550112:0:5777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788178954.550113:0:5777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788178954.550115:0:5777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788178954.550116:0:5777:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788178954.550117:0:5777:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788178954.550119:0:5777:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788178954.550120:0:5777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788178954.550121:0:5777:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788178954.550126:0:5777:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788178954.550129:0:5777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788178954.550130:0:5777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788178954.550132:0:5777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788178954.550133:0:5777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788178954.550134:0:5777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788178954.550135:0:5777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788178954.550136:0:5777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788178954.550136:0:5777:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788178954.550137:0:5777:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788178954.550138:0:5777:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788178954.550139:0:5777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788178954.550139:0:5777:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788178954.550155:0:5777:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788178954.550164:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003bb27886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471957760:0@lo:253: 00000100:00100000:1.0:1788178954.550260:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178954.550290:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a38eec0c going to sleep for 11 seconds 00000100:00100000:3.0:1788178954.553694:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471957760 00000100:00100000:3.0:1788178954.553708:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471957760 00000100:00100000:3.0:1788178954.553770:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788178954.553778:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038d6c81f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+12:5777:x1875041471957760:12345-0@lo:253: 20000000:01000000:3.0:1788178954.553821:0:5790:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788178954.553836:0:5790:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788178954.586404:0:5790:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788178954.586458:0:5790:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788178954.586686:0:5812:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788178954.586691:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788178954.586712:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f9f5d120/0xaa4c98508c4987b6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.586748:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c091e474/0xaa4c98508c498785 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c49877e expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.586756:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f9f5d120/0xaa4c98508c4987b6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.586800:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c091e474/0xaa4c98508c498785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c49877e expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.586824:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c091e474/0xaa4c98508c498785 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c49877e expref: 12 pid: 5791 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178954.586838:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000033ea4f06 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1875041471957888:0@lo:104: 00000100:00100000:1.0:1788178954.587124:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178954.587182:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set 0000000048e65c26 going to sleep for 11 seconds 00000100:00100000:0.0:1788178954.587258:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471957888 00000100:00100000:0.0:1788178954.587267:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471957888 00000100:00100000:0.0:1788178954.587318:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788178954.587327:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c4f501b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efc6f743-3303-46d5-8807-513b82cac1cc+3:5812:x1875041471957888:12345-0@lo:104: 00010000:00010000:0.0:1788178954.587338:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: 0000000012c5a864/0xaa4c98508c49877e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498785 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178954.587384:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788178954.587389:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c4f501b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efc6f743-3303-46d5-8807-513b82cac1cc+3:5812:x1875041471957888:12345-0@lo:104: Request processed in 64us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178954.587396:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788178954.587771:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788178954.587777:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: 0000000012c5a864/0xaa4c98508c49877e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498785 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.587784:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000012c5a864 already unused, calling callback (0000000079a9261d) 10000000:00010000:1.0:1788178954.587787:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: 0000000012c5a864/0xaa4c98508c49877e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c498785 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.587794:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: 0000000012c5a864/0xaa4c98508c49877e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c498785 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788178954.587800:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: 0000000012c5a864/0xaa4c98508c49877e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c498785 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788178954.587819:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788178954.587994:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: 0000000012c5a864/0xaa4c98508c49877e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498785 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.588001:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788178954.588029:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: 0000000012c5a864/0xaa4c98508c49877e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498785 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.588037:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: 0000000012c5a864/0xaa4c98508c49877e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498785 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.588054:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788178954.588056:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788178954.588057:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788178954.588118:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788178954.588129:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d4daf06a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041471958016:0@lo:103: 00000100:00100000:1.0:1788178954.588164:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178954.588299:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471958016 00000100:00100000:1.0:1788178954.588306:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471958016 00010000:00010000:1.0:1788178954.588323:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c091e474/0xaa4c98508c498785 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c49877e expref: 13 pid: 5791 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178954.588342:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788178954.588347:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ab21e58 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+13:3305:x1875041471958016:12345-0@lo:103: 00010000:00010000:1.0:1788178954.588356:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788178954.588360:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c091e474/0xaa4c98508c498785 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c49877e expref: 13 pid: 5791 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.588368:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c091e474/0xaa4c98508c498785 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c49877e expref: 13 pid: 5791 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.588415:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f9f5d120/0xaa4c98508c4987b6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.588423:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f9f5d120/0xaa4c98508c4987b6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788178954.588436:0:5781:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001745849s 00010000:00010000:1.0:1788178954.588440:0:5781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f9f5d120/0xaa4c98508c4987b6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.588445:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f9f5d120/0xaa4c98508c4987b6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.588450:0:5781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f9f5d120/0xaa4c98508c4987b6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.588455:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f9f5d120/0xaa4c98508c4987b6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.588460:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f9f5d120 already unused, calling callback (00000000ac167e88) 00010000:00010000:1.0:1788178954.588462:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f9f5d120/0xaa4c98508c4987b6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.588467:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f9f5d120/0xaa4c98508c4987b6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.588474:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f9f5d120/0xaa4c98508c4987b6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.588483:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788178954.588525:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ab21e58 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+13:3305:x1875041471958016:12345-0@lo:103: Request processed in 178us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178954.588537:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788178954.588570:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d4daf06a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041471958016:0@lo:103: 00010000:00010000:1.0:1788178954.588598:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c091e474/0xaa4c98508c498785 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c49877e expref: 12 pid: 5791 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178954.588607:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000033ea4f06 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1875041471957888:0@lo:104: 00010000:00010000:1.0:1788178954.588641:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f9f5d120/0xaa4c98508c4987b6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.588649:0:5812:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f9f5d120/0xaa4c98508c4987b6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.588654:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f9f5d120/0xaa4c98508c4987b6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178954.588660:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f9f5d120/0xaa4c98508c4987b6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788178954.598735:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038d6c81f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+11:5777:x1875041471957760:12345-0@lo:253: Request processed in 44949us (48467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178954.598754:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788178954.598775:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003bb27886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:5777:1875041471957760:0@lo:253: 10000000:01000000:1.0:1788178954.598795:0:5777:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788178954.598799:0:5777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788178954.598801:0:5777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788178954.598802:0:5777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788178954.598804:0:5777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788178954.598805:0:5777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788178954.598807:0:5777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788178954.598808:0:5777:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788178954.598810:0:5777:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788178954.598811:0:5777:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788178954.598813:0:5777:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788178954.598814:0:5777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788178954.598828:0:5777:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788178954.598982:0:5777:0:(tgt_mount.c:2766:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788178954.605437:0:5777:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788178954.606177:0:5777:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788178954.606565:0:5777:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788178954.606756:0:5777:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788178954.607056:0:5777:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788178954.607299:0:5777:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788178954.608186:0:5777:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788178954.608367:0:5777:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788178954.608691:0:5777:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788178954.608842:0:5777:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788178954.609221:0:5777:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788178954.609402:0:5777:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1788178954.645060:0:5777:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000020:00080000:1.0:1788178954.660333:0:5830:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000040:01000000:0.0:1788178954.660333:0:5777:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788178954.660341:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788178954.660548:0:5831:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788178954.662226:0:5777:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788178954.662319:0:5777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788178954.662751:0:5777:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788178954.662757:0:5777:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788178954.663006:0:5777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788178954.664182:0:5777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788178954.664657:0:5777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788178954.664683:0:5777:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788178954.664951:0:5777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788178954.665487:0:5777:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1788178954.666910:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788178954.667016:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788178954.667137:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788178954.667243:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788178954.667325:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788178954.667455:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788178954.667612:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788178954.667720:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788178954.667808:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788178954.667935:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788178954.668015:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788178954.668143:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788178954.668224:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788178954.668311:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788178954.668417:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788178954.668512:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788178954.668830:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788178954.668947:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788178954.669025:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788178954.669149:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788178954.669243:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788178954.669333:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788178954.669411:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788178954.669505:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788178954.669665:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788178954.669756:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788178954.669845:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788178954.670016:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788178954.670121:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788178954.670217:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788178954.670309:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788178954.670413:0:5777:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788178954.670591:0:5777:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788178954.684108:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1788178954.709199:0:5777:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788178954.709232:0:5777:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4e201d83988 00100000:10000000:1.0:1788178954.709242:0:5777:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788178954.710251:0:5777:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788178954.710265:0:5777:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.102@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788178954.710279:0:5777:0:(tgt_mount.c:2535:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788178954.710303:0:5777:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1788178954.711465:0:5831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788178954.711519:0:5831:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788178954.711523:0:5831:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788178955.522302:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788178956.544018:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788178957.571635:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788178958.593005:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788178959.077138:0:6073:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1788178959.554086:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788178959.554098:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788178959.554101:0:37:0:(import.c:65:import_set_state_nolock()) 00000000f02e6d5f lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788178959.554114:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f02e6d5f using connection 192.168.202.102@tcp/0@lo 00000100:00100000:0.0:1788178959.554136:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008b0a8dc9 x1875041471958272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788178959.554170:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008b0a8dc9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875041471958272:0@lo:38: 00000100:00100000:0.0:1788178959.554229:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178959.554295:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471958272 00000100:00100000:0.0:1788178959.554301:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471958272 00000100:00100000:0.0:1788178959.554327:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788178959.554333:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6c593c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1875041471958272:12345-0@lo:38: 00010000:00080000:0.0:1788178959.554356:0:5798:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 155 last 0 00000020:00000080:0.0:1788178959.554391:0:5798:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xaa4c98508c4987bd 00000004:00100000:0.0:1788178959.554430:0:5798:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788178959.554542:0:5798:0:(import.c:65:import_set_state_nolock()) 00000000a86d3ccb : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788178959.554668:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bf9fc061 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041471958144:0@lo:400: 00000100:00100000:3.0:1788178959.554699:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178959.554730:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471958144 00000100:00100000:3.0:1788178959.554733:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471958144 00000100:00100000:3.0:1788178959.554758:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788178959.554763:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069abaf70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+11:3307:x1875041471958144:12345-0@lo:400: 00000100:00100000:3.0:1788178959.554793:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069abaf70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+11:3307:x1875041471958144:12345-0@lo:400: Request processed in 29us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178959.554799:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788178959.554883:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bf9fc061 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041471958144:0@lo:400: 00000100:00100000:0.0:1788178959.555117:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6c593c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875041471958272:12345-0@lo:38: Request processed in 782us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178959.555123:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788178959.555153:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008b0a8dc9 x1875041471958272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788178969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788178959.555165:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788178959.555172:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788178959.555176:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788178959.555178:0:3304:0:(import.c:65:import_set_state_nolock()) 00000000f02e6d5f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788178959.555182:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008b0a8dc9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875041471958272:0@lo:38: 00010000:00010000:0.0:1788178959.646013:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788178960.645765:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788178961.618271:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788178961.618278:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9bc9070e2800 from 3 10000000:01000000:3.0:1788178961.618283:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788178961.618334:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: 000000006acf7197/0xaa4c98508c4987c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178961.618348:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: 000000006acf7197/0xaa4c98508c4987c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178961.618360:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: 000000006acf7197/0xaa4c98508c4987c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788178961.618387:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fc195f4e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471958400:0@lo:101: 00000100:00100000:3.0:1788178961.618458:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178961.618509:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 000000007d5b0b56 going to sleep for 11 seconds 00000100:00100000:0.0:1788178961.618623:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471958400 00000100:00100000:0.0:1788178961.618633:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471958400 00000100:00100000:0.0:1788178961.618690:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788178961.618708:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b10f5df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+11:5793:x1875041471958400:12345-0@lo:101: 00010000:00010000:0.0:1788178961.618721:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788178961.618733:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b0c10714/0xaa4c98508c4987cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c4987c4 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178961.618753:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b0c10714/0xaa4c98508c4987cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c4987c4 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178961.618763:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b0c10714/0xaa4c98508c4987cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c4987c4 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178961.618771:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b0c10714, rc 0) 00000100:00100000:0.0:1788178961.619046:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b10f5df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+12:5793:x1875041471958400:12345-0@lo:101: Request processed in 339us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178961.619052:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788178961.622425:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fc195f4e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471958400:0@lo:101: 00010000:00010000:2.0:1788178961.622452:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: 000000006acf7197/0xaa4c98508c4987c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c4987cb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178961.622464:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: 000000006acf7197/0xaa4c98508c4987c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c4987cb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788178961.622548:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f95b805d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471958528:0@lo:256: 00000100:00100000:2.0:1788178961.622615:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788178961.622656:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 000000002429daf3 going to sleep for 11 seconds 00000100:00100000:1.0:1788178961.624880:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471958528 00000100:00100000:1.0:1788178961.624893:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471958528 00000100:00100000:1.0:1788178961.624966:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788178961.624974:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a957c035 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+12:5793:x1875041471958528:12345-0@lo:256: 20000000:01000000:1.0:1788178961.624997:0:5789:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788178961.625013:0:5789:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788178961.625016:0:5789:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788178961.625129:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a957c035 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+12:5793:x1875041471958528:12345-0@lo:256: Request processed in 156us (2514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178961.625137:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788178961.625185:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f95b805d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471958528:0@lo:256: 10000000:01000000:1.0:1788178961.625229:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788178961.625237:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: 000000006acf7197/0xaa4c98508c4987c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c4987cb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178961.625310:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: 000000006acf7197/0xaa4c98508c4987c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c4987cb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178961.670898:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788178962.688199:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788178963.716403:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788178964.678334:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003bb27886 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471958656:0@lo:400: 00000100:00100000:0.0:1788178964.678410:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178964.678509:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471958656 00000100:00100000:3.0:1788178964.678517:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471958656 00000100:00100000:3.0:1788178964.678576:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788178964.678585:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e27fc991 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+12:3308:x1875041471958656:12345-0@lo:400: 00000100:00100000:1.0:1788178964.678690:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000033ea4f06 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041471958784:0@lo:400: 00000100:00100000:1.0:1788178964.678758:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178964.678794:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471958784 00000100:00100000:1.0:1788178964.678798:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471958784 00000100:00100000:1.0:1788178964.678826:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788178964.678832:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4daf06a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041471958784:12345-0@lo:400: 00000100:00100000:1.0:1788178964.678900:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4daf06a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041471958784:12345-0@lo:400: Request processed in 68us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178964.678908:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788178964.678943:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000033ea4f06 x1875041471958784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788178980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788178964.678968:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000033ea4f06 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041471958784:0@lo:400: 00000100:00100000:3.0:1788178964.685098:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e27fc991 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+12:3308:x1875041471958656:12345-0@lo:400: Request processed in 6498us (6671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178964.685115:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788178964.688456:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003bb27886 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471958656:0@lo:400: 00010000:00010000:1.0:1788178964.737320:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788178964.744298:0:6275:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe719f9630 20000000:00000080:3.0:1788178964.744316:0:6275:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bc926560400 uarg=0000000000000000 20000000:01000000:3.0:1788178964.744348:0:6275:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788178964.744354:0:6275:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788178964.744365:0:6275:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788178964.744620:0:6275:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788178964.744631:0:6275:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788178964.750695:0:6275:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788178964.751477:0:6275:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788178964.751542:0:6275:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788178964.751590:0:6275:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788178964.751608:0:6275:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788178964.751627:0:6275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000baef2adf/0xaa4c98508c4987d2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178964.751645:0:6275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000064c040f3/0xaa4c98508c498793 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c49878c expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178964.751652:0:6275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000baef2adf/0xaa4c98508c4987d2 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178964.751691:0:6275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000064c040f3/0xaa4c98508c498793 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c49878c expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178964.751705:0:6275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000064c040f3/0xaa4c98508c498793 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c49878c expref: 11 pid: 5791 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788178964.751718:0:6275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006b4f7260 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6275:1875041471958912:0@lo:104: 00000100:00100000:3.0:1788178964.751779:0:6275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178964.751837:0:6275:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d66201a1 going to sleep for 11 seconds 00000100:00100000:2.0:1788178964.752330:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471958912 00000100:00100000:2.0:1788178964.752338:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471958912 00000100:00100000:2.0:1788178964.752381:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788178964.752388:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe35cf49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+3:6275:x1875041471958912:12345-0@lo:104: 00010000:00010000:2.0:1788178964.752401:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: 00000000993384da/0xaa4c98508c49878c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498793 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178964.752641:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788178964.752647:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe35cf49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+3:6275:x1875041471958912:12345-0@lo:104: Request processed in 260us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788178964.752655:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788178964.752707:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788178964.752712:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: 00000000993384da/0xaa4c98508c49878c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498793 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178964.752720:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000993384da already unused, calling callback (0000000079a9261d) 10000000:00010000:0.0:1788178964.752723:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: 00000000993384da/0xaa4c98508c49878c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c498793 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178964.752730:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: 00000000993384da/0xaa4c98508c49878c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c498793 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788178964.752737:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: 00000000993384da/0xaa4c98508c49878c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c498793 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788178964.752743:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788178964.752779:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: 00000000993384da/0xaa4c98508c49878c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498793 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178964.752785:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788178964.752804:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: 00000000993384da/0xaa4c98508c49878c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498793 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178964.752810:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: 00000000993384da/0xaa4c98508c49878c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498793 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178964.752825:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788178964.752827:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788178964.752828:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788178964.753102:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008b0a8dc9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041471959040:0@lo:103: 00000100:00100000:0.0:1788178964.753161:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788178964.753403:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471959040 00000100:00100000:2.0:1788178964.753409:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471959040 00010000:00010000:2.0:1788178964.753427:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000064c040f3/0xaa4c98508c498793 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c49878c expref: 12 pid: 5791 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788178964.753460:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788178964.753466:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca804eda pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+12:3306:x1875041471959040:12345-0@lo:103: 00010000:00010000:2.0:1788178964.753476:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788178964.753480:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000064c040f3/0xaa4c98508c498793 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c49878c expref: 12 pid: 5791 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178964.753490:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000064c040f3/0xaa4c98508c498793 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c49878c expref: 12 pid: 5791 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178964.753510:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000baef2adf/0xaa4c98508c4987d2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178964.753517:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000baef2adf/0xaa4c98508c4987d2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178964.753530:0:5781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000baef2adf/0xaa4c98508c4987d2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178964.753548:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000baef2adf/0xaa4c98508c4987d2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178964.753554:0:5781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000baef2adf/0xaa4c98508c4987d2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178964.753559:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000baef2adf/0xaa4c98508c4987d2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178964.753564:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000baef2adf already unused, calling callback (00000000ac167e88) 00010000:00010000:2.0:1788178964.753567:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000baef2adf/0xaa4c98508c4987d2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178964.753573:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000baef2adf/0xaa4c98508c4987d2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178964.753581:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000baef2adf/0xaa4c98508c4987d2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178964.753590:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788178964.753619:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca804eda pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+12:3306:x1875041471959040:12345-0@lo:103: Request processed in 153us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788178964.753634:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788178964.753668:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008b0a8dc9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041471959040:0@lo:103: 00010000:00010000:3.0:1788178964.753914:0:6275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000064c040f3/0xaa4c98508c498793 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c49878c expref: 11 pid: 5791 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788178964.753927:0:6275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006b4f7260 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6275:1875041471958912:0@lo:104: 00010000:00010000:3.0:1788178964.753939:0:6275:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000baef2adf/0xaa4c98508c4987d2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178964.753952:0:6275:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000baef2adf/0xaa4c98508c4987d2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178964.753958:0:6275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000baef2adf/0xaa4c98508c4987d2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178964.753963:0:6275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000baef2adf/0xaa4c98508c4987d2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178965.762949:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788178966.785734:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788178967.809034:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788178968.832953:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788178969.792169:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006b4f7260 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041471959168:0@lo:400: 00000100:00100000:1.0:1788178969.792242:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178969.792303:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788178969.792309:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004ee25682 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041471959296:0@lo:400: 00000100:00100000:1.0:1788178969.792333:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178969.792409:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471959168 00000100:00100000:3.0:1788178969.792417:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471959168 00000100:00100000:3.0:1788178969.792467:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788178969.792474:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001e5ee6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+11:3307:x1875041471959168:12345-0@lo:400: 00000100:00100000:3.0:1788178969.792553:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001e5ee6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+11:3307:x1875041471959168:12345-0@lo:400: Request processed in 80us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178969.792560:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788178969.792590:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471959296 00000100:00100000:3.0:1788178969.792594:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471959296 00000100:00100000:3.0:1788178969.792618:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788178969.792624:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033ea4f06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041471959296:12345-0@lo:400: 00000100:00100000:3.0:1788178969.792653:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033ea4f06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041471959296:12345-0@lo:400: Request processed in 30us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178969.792659:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788178969.792699:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004ee25682 x1875041471959296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788178985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788178969.792712:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004ee25682 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041471959296:0@lo:400: 00000100:00100000:3.0:1788178969.792722:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006b4f7260 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041471959168:0@lo:400: 10000000:01000000:1.0:1788178969.793015:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788178969.793019:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bc9070e2800 from 1 10000000:01000000:1.0:1788178969.793023:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788178969.793053:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: 000000001147547e/0xaa4c98508c4987d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178969.793062:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: 000000001147547e/0xaa4c98508c4987d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178969.793071:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: 000000001147547e/0xaa4c98508c4987d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178969.793086:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000face5373 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471959424:0@lo:101: 00000100:00100000:1.0:1788178969.793112:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178969.793140:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 0000000007a3c321 going to sleep for 11 seconds 00000100:00100000:2.0:1788178969.793477:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471959424 00000100:00100000:2.0:1788178969.793491:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471959424 00000100:00100000:2.0:1788178969.793526:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788178969.793532:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a603bf37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+11:5793:x1875041471959424:12345-0@lo:101: 00010000:00010000:2.0:1788178969.793541:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788178969.793552:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000044ad5c13/0xaa4c98508c4987e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c4987d9 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178969.793572:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000044ad5c13/0xaa4c98508c4987e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c4987d9 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178969.793582:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000044ad5c13/0xaa4c98508c4987e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c4987d9 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178969.793591:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000044ad5c13, rc 0) 00000100:00100000:2.0:1788178969.793633:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a603bf37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+12:5793:x1875041471959424:12345-0@lo:101: Request processed in 101us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788178969.793639:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788178969.793764:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000face5373 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471959424:0@lo:101: 00010000:00010000:1.0:1788178969.793777:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: 000000001147547e/0xaa4c98508c4987d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c4987e0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178969.793786:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: 000000001147547e/0xaa4c98508c4987d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c4987e0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178969.793873:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000face5373 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471959552:0@lo:501: 00000100:00100000:1.0:1788178969.793898:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178969.793921:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 0000000007a3c321 going to sleep for 11 seconds 00000100:00100000:2.0:1788178969.794034:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471959552 00000100:00100000:2.0:1788178969.794038:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471959552 00000100:00100000:2.0:1788178969.794068:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788178969.794075:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd90c12c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+12:5793:x1875041471959552:12345-0@lo:501: 00000100:00100000:2.0:1788178969.795514:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd90c12c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+12:5793:x1875041471959552:12345-0@lo:501: Request processed in 1434us (1609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788178969.795526:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788178969.806077:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000face5373 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471959552:0@lo:501: 00000100:00100000:3.0:1788178969.806159:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006b4f7260 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471959680:0@lo:503: 00000100:00100000:3.0:1788178969.806267:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178969.806371:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 00000000daca6d85 going to sleep for 11 seconds 00000100:00100000:0.0:1788178969.815037:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471959680 00000100:00100000:0.0:1788178969.815054:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471959680 00000100:00100000:0.0:1788178969.815236:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788178969.815246:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e719d0e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+12:5793:x1875041471959680:12345-0@lo:503: 00000100:00100000:0.0:1788178969.815900:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e719d0e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+12:5793:x1875041471959680:12345-0@lo:503: Request processed in 653us (9631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178969.815909:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788178969.815912:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006b4f7260 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471959680:0@lo:503: 00000100:00100000:3.0:1788178969.819118:0:6554:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006b4f7260 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:6554:1875041471959808:0@lo:502: 00000100:00100000:3.0:1788178969.819211:0:6554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178969.819332:0:6554:0:(client.c:2702:ptlrpc_set_wait()) set 00000000932067ed going to sleep for 11 seconds 00000100:00100000:2.0:1788178969.819504:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471959808 00000100:00100000:2.0:1788178969.819513:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471959808 00000100:00100000:2.0:1788178969.819562:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788178969.819570:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c7bad24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+12:6554:x1875041471959808:12345-0@lo:502: 00000100:00100000:2.0:1788178969.819953:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c7bad24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+12:6554:x1875041471959808:12345-0@lo:502: Request processed in 384us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788178969.819961:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788178969.822048:0:6554:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006b4f7260 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:6554:1875041471959808:0@lo:502: 00000020:01000000:3.0:1788178969.822131:0:6554:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788178969.822141:0:6554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788178969.822143:0:6554:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788178969.822150:0:6554:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bc9070e2800 00000020:00000080:3.0:1788178969.822153:0:6554:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788178969.822198:0:6554:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:6554:1875041471959936:0@lo:502: 00000100:00100000:3.0:1788178969.822250:0:6554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178969.822293:0:6554:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc910ebe0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788178969.822480:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471959936 00000100:00100000:0.0:1788178969.822495:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471959936 00000100:00100000:0.0:1788178969.822536:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788178969.822543:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+12:6554:x1875041471959936:12345-0@lo:502: 00000100:00100000:0.0:1788178969.822716:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+12:6554:x1875041471959936:12345-0@lo:502: Request processed in 172us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178969.822723:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788178969.822799:0:6554:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:6554:1875041471959936:0@lo:502: 00000020:01000000:3.0:1788178969.822815:0:6554:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788178969.822819:0:6554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788178969.822820:0:6554:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788178969.822824:0:6554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788178969.822980:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788178969.822998:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788178969.823008:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317f000/0xaa4c98508c4987d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c4987e0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178969.823019:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc91317f000/0xaa4c98508c4987d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c4987e0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178969.856998:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788178970.884241:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788178971.259821:0:6587:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788178971.259825:0:6587:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788178971.259996:0:6587:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9bc913608800 00000020:01000004:0.0:1788178971.260010:0:6587:0:(tgt_mount.c:2577:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788178971.260021:0:6587:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788178971.260033:0:6587:0:(genops.c:414:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9bc926583380) 00000020:00000080:0.0:1788178971.260047:0:6587:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788178971.321616:0:6587:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788178971.322749:0:6587:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788178971.375128:0:6587:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788178971.386946:0:6587:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788178971.386985:0:6587:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788178971.387052:0:6587:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788178971.387082:0:6587:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788178971.387721:0:6587:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788178971.387733:0:6587:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788178971.387745:0:6587:0:(genops.c:1407:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xaa4c98508c4987ee 00000020:01000004:3.0:1788178971.387752:0:6587:0:(tgt_mount.c:2662:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788178971.387774:0:6587:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.102@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788178971.387777:0:6587:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788178971.387782:0:6587:0:(tgt_mount.c:1875:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788178971.387786:0:6587:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788178971.388217:0:6587:0:(genops.c:414:class_newdev()) Allocate new device OSS (ffff9bc9265c19c0) 00000020:00000080:3.0:1788178971.388232:0:6587:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788178971.391717:0:6587:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788178971.393156:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788178971.393166:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788178971.394982:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788178971.394995:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788178971.395172:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788178971.395177:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788178971.399296:0:6587:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788178971.400502:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788178971.400509:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788178971.402127:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788178971.402137:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788178971.470273:0:6587:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788178971.474178:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788178971.474188:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788178971.484758:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788178971.484780:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788178971.486412:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788178971.486424:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788178971.491188:0:6587:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788178971.491660:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788178971.491676:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788178971.492498:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788178971.492506:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788178971.611322:0:6587:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788178971.611655:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788178971.612160:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788178971.619907:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788178971.619928:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788178971.620615:0:6587:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788178971.620640:0:6587:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788178971.620646:0:6587:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.102@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788178971.691905:0:6587:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.102@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788178971.691947:0:6587:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.102@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788178971.691952:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788178971.691954:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788178971.691955:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788178971.691957:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788178971.691958:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788178971.691959:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788178971.691961:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788178971.691962:0:6587:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788178971.691963:0:6587:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788178971.691965:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788178971.691966:0:6587:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788178971.691975:0:6587:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788178971.691977:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788178971.691979:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788178971.691979:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788178971.691980:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788178971.691981:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788178971.691982:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788178971.691983:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788178971.691984:0:6587:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788178971.691985:0:6587:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788178971.691986:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788178971.691987:0:6587:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788178971.692016:0:6587:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788178971.692032:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471960064:0@lo:253: 00000100:00100000:3.0:1788178971.692220:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788178971.692348:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471960064 00000100:00100000:2.0:1788178971.692356:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471960064 00000100:00100000:2.0:1788178971.692414:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788178971.692423:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+12:6587:x1875041471960064:12345-0@lo:253: 20000000:01000000:2.0:1788178971.692456:0:5789:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788178971.692475:0:5789:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788178971.692481:0:5789:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788178971.692484:0:5789:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788178971.693377:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788178971.693613:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788178971.693628:0:5789:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788178971.693666:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1788178971.693674:0:5789:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788178971.693699:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1788178971.693743:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788178971.694108:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788178971.694124:0:5789:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.102@tcp 20000000:01000000:2.0:1788178971.694126:0:5789:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.102@tcp (null) (null) (null) 00000040:00080000:2.0:1788178971.694156:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788178971.694163:0:5789:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788178971.694205:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788178971.694212:0:5789:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.102@tcp (null) (null) 00000040:00080000:2.0:1788178971.694252:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788178971.694260:0:5789:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788178971.694283:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788178971.694339:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1788178971.694980:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788178971.694995:0:5789:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.102@tcp 20000000:01000000:2.0:1788178971.694996:0:5789:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.102@tcp (null) (null) (null) 00000040:00080000:2.0:1788178971.695025:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788178971.695031:0:5789:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788178971.695056:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788178971.695061:0:5789:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.102@tcp (null) (null) 00000040:00080000:2.0:1788178971.695097:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788178971.695105:0:5789:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788178971.695133:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1788178971.695167:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1788178971.695189:0:5789:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1788178971.695192:0:5789:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1788178971.695198:0:5789:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788178971.695199:0:5789:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788178971.695201:0:5789:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788178971.695214:0:5789:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788178971.695216:0:5789:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788178971.695248:0:5789:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788178971.695251:0:5789:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000100:00100000:3.0:1788178971.695802:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9054b4300 going to sleep for 11 seconds 20000000:01000000:0.0:1788178971.702360:0:6602:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788178971.702710:0:6602:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788178971.702757:0:6602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788178971.707950:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1788178971.708009:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1788178971.708046:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1788178971.708059:0:5789:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788178971.708062:0:5789:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788178971.716751:0:6603:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788178971.716881:0:6603:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788178971.716945:0:6603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788178971.717331:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788178971.717373:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788178971.717446:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788178971.717460:0:5789:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788178971.717463:0:5789:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788178971.718120:0:6604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1788178971.718334:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1788178971.719009:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1788178971.719090:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:1.0:1788178971.719110:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788178971.719129:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bc91317f800/0xaa4c98508c4987fc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178971.719148:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc942173e00/0xaa4c98508c498715 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c49870e expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178971.719156:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc901498400/0xaa4c98508c498731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c49872a expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178971.719163:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c4987a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c49879a expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178971.719169:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bc91317f800/0xaa4c98508c4987fc lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178971.719207:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c4987a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c49879a expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178971.719223:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c4987a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c49879a expref: 12 pid: 5789 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178971.719237:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bf9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5789:1875041471960192:0@lo:104: 00000100:00100000:1.0:1788178971.719318:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788178971.719368:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc901498400/0xaa4c98508c498731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c49872a expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178971.719559:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bc901498400/0xaa4c98508c498731 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c49872a expref: 12 pid: 5789 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178971.719569:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bf8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5789:1875041471960320:0@lo:104: 00000100:00100000:1.0:1788178971.719592:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788178971.719655:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc942173e00/0xaa4c98508c498715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c49870e expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178971.719662:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bc942173e00/0xaa4c98508c498715 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c49870e expref: 12 pid: 5790 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178971.719669:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bfaa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5789:1875041471960448:0@lo:104: 00000100:00100000:1.0:1788178971.719687:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178971.727287:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc902f9b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788178971.732581:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471960192 00000100:00100000:0.0:1788178971.732598:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471960192 00000100:00100000:0.0:1788178971.732655:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471960320 00000100:00100000:0.0:1788178971.732659:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471960320 00000100:00100000:0.0:1788178971.732670:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471960448 00000100:00100000:0.0:1788178971.732672:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471960448 00000100:00100000:0.0:1788178971.732689:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788178971.732698:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efc6f743-3303-46d5-8807-513b82cac1cc+5:5789:x1875041471960192:12345-0@lo:104: 00010000:00010000:0.0:1788178971.732716:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc900030a00/0xaa4c98508c49879a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c4987a1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.732833:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788178971.732839:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efc6f743-3303-46d5-8807-513b82cac1cc+5:5789:x1875041471960192:12345-0@lo:104: Request processed in 143us (13522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178971.732889:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788178971.732909:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788178971.732915:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efc6f743-3303-46d5-8807-513b82cac1cc+4:5789:x1875041471960320:12345-0@lo:104: 00010000:00010000:0.0:1788178971.732924:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c49872a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498731 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.732962:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788178971.732968:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efc6f743-3303-46d5-8807-513b82cac1cc+4:5789:x1875041471960320:12345-0@lo:104: Request processed in 54us (13375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178971.732974:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788178971.732994:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788178971.732999:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc900030a00/0xaa4c98508c49879a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c4987a1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.733007:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc900030a00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1788178971.733011:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc900030a00/0xaa4c98508c49879a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c4987a1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.733021:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc900030a00/0xaa4c98508c49879a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c4987a1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788178971.733028:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc900030a00/0xaa4c98508c49879a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c4987a1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788178971.733034:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788178971.733243:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788178971.733462:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bf9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5789:1875041471960192:0@lo:104: 00000100:00100000:1.0:1788178971.733510:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bf8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5789:1875041471960320:0@lo:104: 00000100:00100000:1.0:1788178971.733576:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788178971.733585:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efc6f743-3303-46d5-8807-513b82cac1cc+3:5789:x1875041471960448:12345-0@lo:104: 00010000:00010000:1.0:1788178971.733594:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc900030c00/0xaa4c98508c49870e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498715 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178971.733645:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bfaa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5789:1875041471960448:0@lo:104: 00010000:00010000:1.0:1788178971.733671:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bc91317f800/0xaa4c98508c4987fc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178971.733697:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788178971.733702:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efc6f743-3303-46d5-8807-513b82cac1cc+3:5789:x1875041471960448:12345-0@lo:104: Request processed in 120us (14014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178971.733709:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788178971.734037:0:6605:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788178971.734242:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c49872a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498731 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178971.734252:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317ee00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:3.0:1788178971.734255:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c49872a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c498731 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178971.734263:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c49872a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c498731 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788178971.734269:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c49872a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c498731 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788178971.734274:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788178971.734317:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c49872a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498731 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178971.734324:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788178971.734347:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c49872a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498731 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178971.734354:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c49872a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498731 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178971.734367:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788178971.734369:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788178971.734370:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788178971.734400:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041471960576:0@lo:103: 00000100:00100000:3.0:1788178971.734445:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788178971.734940:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc900030a00/0xaa4c98508c49879a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c4987a1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.734950:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788178971.734977:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc900030a00/0xaa4c98508c49879a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c4987a1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.734984:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc900030a00/0xaa4c98508c49879a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c4987a1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.734995:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788178971.734997:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788178971.734999:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788178971.735053:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471960576 00000100:00100000:0.0:1788178971.735060:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471960576 00000100:00100000:3.0:1788178971.735174:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788178971.735184:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041471960704:0@lo:103: 00000100:00100000:3.0:1788178971.735217:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178971.735256:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471960704 00000100:00100000:3.0:1788178971.735259:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471960704 00010000:00010000:0.0:1788178971.736139:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc901498400/0xaa4c98508c498731 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c49872a expref: 14 pid: 5789 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788178971.736177:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788178971.736185:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+14:3305:x1875041471960576:12345-0@lo:103: 00010000:00010000:0.0:1788178971.736199:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788178971.736204:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc901498400/0xaa4c98508c498731 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c49872a expref: 14 pid: 5789 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.736213:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc901498400/0xaa4c98508c498731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c49872a expref: 14 pid: 5789 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.736229:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc901498400/0xaa4c98508c498731 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c49872a expref: 14 pid: 5789 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.736246:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788178971.736288:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+13:3305:x1875041471960576:12345-0@lo:103: Request processed in 104us (1842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178971.736295:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788178971.736345:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788178971.736355:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788178971.736357:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788178971.736507:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041471960576:0@lo:103: 00010000:00010000:1.0:1788178971.736627:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc900030c00/0xaa4c98508c49870e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498715 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178971.736637:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc900030c00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:1.0:1788178971.736641:0:6605:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc900030c00/0xaa4c98508c49870e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c498715 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178971.736650:0:6605:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc900030c00/0xaa4c98508c49870e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c498715 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788178971.736656:0:6605:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc900030c00/0xaa4c98508c49870e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c498715 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788178971.736661:0:6605:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788178971.736695:0:6605:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc900030c00/0xaa4c98508c49870e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498715 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178971.736702:0:6605:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788178971.736717:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc900030c00/0xaa4c98508c49870e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498715 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178971.736723:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc900030c00/0xaa4c98508c49870e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498715 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178971.736748:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788178971.736749:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788178971.736751:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788178971.736907:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788178971.736918:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471960832:0@lo:103: 00000100:00100000:1.0:1788178971.736947:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178971.737158:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471960832 00000100:00100000:0.0:1788178971.737164:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471960832 00010000:00010000:3.0:1788178971.737301:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c4987a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c49879a expref: 13 pid: 5789 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788178971.737320:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788178971.737326:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efc6f743-3303-46d5-8807-513b82cac1cc+13:3305:x1875041471960704:12345-0@lo:103: 00010000:00010000:3.0:1788178971.737335:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788178971.737340:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c4987a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c49879a expref: 13 pid: 5789 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178971.737349:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c4987a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c49879a expref: 13 pid: 5789 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178971.737367:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c4987a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c49879a expref: 13 pid: 5789 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178971.739636:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788178971.739729:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efc6f743-3303-46d5-8807-513b82cac1cc+12:3305:x1875041471960704:12345-0@lo:103: Request processed in 2398us (4507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178971.739740:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788178971.739965:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041471960704:0@lo:103: 00010000:00010000:0.0:1788178971.740581:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc942173e00/0xaa4c98508c498715 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c49870e expref: 11 pid: 5790 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788178971.740619:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788178971.740628:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+11:3308:x1875041471960832:12345-0@lo:103: 00010000:00010000:0.0:1788178971.740641:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788178971.740646:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc942173e00/0xaa4c98508c498715 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c49870e expref: 11 pid: 5790 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.740658:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc942173e00/0xaa4c98508c498715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c49870e expref: 11 pid: 5790 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.740676:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc942173e00/0xaa4c98508c498715 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c49870e expref: 11 pid: 5790 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.740691:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bc91317f800/0xaa4c98508c4987fc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.740699:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc91317f800/0xaa4c98508c4987fc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.740715:0:5781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bc91317f800/0xaa4c98508c4987fc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.740723:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bc91317f800/0xaa4c98508c4987fc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.740747:0:5781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bc91317f800/0xaa4c98508c4987fc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.740754:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bc91317f800/0xaa4c98508c4987fc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.740760:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f800 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788178971.740764:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bc91317f800/0xaa4c98508c4987fc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.740772:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bc91317f800/0xaa4c98508c4987fc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.740804:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bc91317f800/0xaa4c98508c4987fc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.740815:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788178971.740886:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+10:3308:x1875041471960832:12345-0@lo:103: Request processed in 259us (3937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178971.740894:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788178971.741035:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471960832:0@lo:103: 00010000:00010000:2.0:1788178971.741122:0:5789:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bc91317f800/0xaa4c98508c4987fc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178971.741132:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bc91317f800/0xaa4c98508c4987fc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178971.741138:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc91317f800/0xaa4c98508c4987fc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788178971.741160:0:5789:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788178971.841723:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+9:6587:x1875041471960064:12345-0@lo:253: Request processed in 149291us (149492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178971.841737:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788178971.842018:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471960064:0@lo:253: 10000000:01000000:0.0:1788178971.842033:0:6587:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788178971.842036:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788178971.842038:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788178971.842039:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788178971.842040:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788178971.842041:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788178971.842042:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788178971.842044:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788178971.842045:0:6587:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788178971.842046:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788178971.842064:0:6587:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788178971.842082:0:6587:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bc913608800 from lustre-OST0000 10000000:01000000:0.0:1788178971.842106:0:6587:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788178971.842109:0:6587:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788178971.842115:0:6587:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bc9265819c0 local copy 10000000:01000000:0.0:1788178971.842118:0:6587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788178971.842153:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900030a00/0xaa4c98508c498803 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.842164:0:6587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.102@tcp lock: ffff9bc900030a00/0xaa4c98508c498803 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.842172:0:6587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc900030a00/0xaa4c98508c498803 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788178971.842189:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471960960:0@lo:101: 00000100:00100000:0.0:1788178971.842224:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178971.842320:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc903589c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788178971.842377:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471960960 00000100:00100000:2.0:1788178971.842392:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471960960 00000100:00100000:2.0:1788178971.842436:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788178971.842445:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+9:6587:x1875041471960960:12345-0@lo:101: 00010000:00010000:2.0:1788178971.842474:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788178971.842488:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc942172200/0xaa4c98508c49880a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c498803 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178971.842511:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc942172200/0xaa4c98508c49880a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c498803 expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178971.842522:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc942172200/0xaa4c98508c49880a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498803 expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178971.842531:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc942172200, rc 0) 00000100:00100000:2.0:1788178971.842565:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+10:6587:x1875041471960960:12345-0@lo:101: Request processed in 121us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788178971.842572:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788178971.842743:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471960960:0@lo:101: 00010000:00010000:3.0:1788178971.842758:0:6587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc900030a00/0xaa4c98508c498803 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xaa4c98508c49880a expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178971.842767:0:6587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc900030a00/0xaa4c98508c498803 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xaa4c98508c49880a expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788178971.842908:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471961088:0@lo:501: 00000100:00100000:3.0:1788178971.842937:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178971.842995:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471961088 00000100:00100000:0.0:1788178971.842999:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471961088 00000100:00100000:0.0:1788178971.843031:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788178971.843037:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+10:6587:x1875041471961088:12345-0@lo:501: 00000100:00100000:0.0:1788178971.843215:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+10:6587:x1875041471961088:12345-0@lo:501: Request processed in 177us (277us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788178971.843222:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788178971.845580:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9054b4780 going to sleep for 11 seconds 00000100:00100000:3.0:1788178971.845620:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471961088:0@lo:501: 10000000:01000000:3.0:1788178971.845641:0:6587:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788178971.845698:0:6587:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788178971.845707:0:6587:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900030a00/0xaa4c98508c498803 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xaa4c98508c49880a expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178971.845718:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900030a00/0xaa4c98508c498803 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xaa4c98508c49880a expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178971.845746:0:6587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff9bc900030a00/0xaa4c98508c498803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xaa4c98508c49880a expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178971.846512:0:6587:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788178971.846542:0:6587:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bc913608800 10000000:01000000:3.0:1788178971.846549:0:6587:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788178971.846554:0:6587:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9bc9265819c0 10000000:01000000:3.0:1788178971.846557:0:6587:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788178971.846560:0:6587:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9bc9265819c0 from 1 10000000:01000000:3.0:1788178971.846563:0:6587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788178971.846596:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc901498600/0xaa4c98508c498811 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178971.846605:0:6587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc901498600/0xaa4c98508c498811 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178971.846615:0:6587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc901498600/0xaa4c98508c498811 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788178971.846635:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471961216:0@lo:101: 00000100:00100000:3.0:1788178971.846706:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178971.846743:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9054b4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788178971.846834:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471961216 00000100:00100000:1.0:1788178971.846842:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471961216 00000100:00100000:1.0:1788178971.846902:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788178971.846910:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+10:6587:x1875041471961216:12345-0@lo:101: 00010000:00010000:1.0:1788178971.846922:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788178971.846935:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc91317ea00/0xaa4c98508c498818 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c498811 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178971.846957:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc91317ea00/0xaa4c98508c498818 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c498811 expref: 11 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178971.846967:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc91317ea00/0xaa4c98508c498818 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498811 expref: 11 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178971.846976:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317ea00, rc 0) 00000100:00100000:1.0:1788178971.847018:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+11:6587:x1875041471961216:12345-0@lo:101: Request processed in 109us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178971.847037:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788178971.847912:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471961216:0@lo:101: 00010000:00010000:3.0:1788178971.847929:0:6587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc901498600/0xaa4c98508c498811 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498818 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178971.847939:0:6587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc901498600/0xaa4c98508c498811 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498818 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788178971.847970:0:6587:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788178971.847990:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc901498600/0xaa4c98508c498811 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498818 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178971.847998:0:6587:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc901498600/0xaa4c98508c498811 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498818 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788178971.848005:0:6587:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788178971.848009:0:6587:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788178971.848014:0:6587:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788178971.848016:0:6587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788178971.848035:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc901498000/0xaa4c98508c49881f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178971.848043:0:6587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc901498000/0xaa4c98508c49881f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178971.848051:0:6587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc901498000/0xaa4c98508c49881f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788178971.848064:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471961344:0@lo:101: 00000100:00100000:3.0:1788178971.848096:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178971.848169:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9054b4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788178971.850948:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471961344 00000100:00100000:2.0:1788178971.850962:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471961344 00000100:00100000:2.0:1788178971.851021:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788178971.851031:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+11:6587:x1875041471961344:12345-0@lo:101: 00010000:00010000:2.0:1788178971.851047:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788178971.851065:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc942172400/0xaa4c98508c498826 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c49881f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178971.851094:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc942172400/0xaa4c98508c498826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c49881f expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178971.851106:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc942172400/0xaa4c98508c498826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c49881f expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178971.851115:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc942172400, rc 0) 00000100:00100000:2.0:1788178971.851207:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+12:6587:x1875041471961344:12345-0@lo:101: Request processed in 176us (3109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788178971.851214:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1788178971.851523:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788178971.851531:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc900030a00/0xaa4c98508c498803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xaa4c98508c49880a expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.851540:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc900030a00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1788178971.851550:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc900030a00/0xaa4c98508c498803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xaa4c98508c49880a expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.851559:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc900030a00/0xaa4c98508c498803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xaa4c98508c49880a expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788178971.851567:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc900030a00/0xaa4c98508c498803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xaa4c98508c49880a expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788178971.851573:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788178971.851600:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc900030a00/0xaa4c98508c498803 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xaa4c98508c49880a expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.851606:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788178971.851636:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc900030a00/0xaa4c98508c498803 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xaa4c98508c49880a expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.851644:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc900030a00/0xaa4c98508c498803 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xaa4c98508c49880a expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.851658:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788178971.851660:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788178971.851662:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788178971.851733:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471961344:0@lo:101: 00010000:00010000:3.0:1788178971.851750:0:6587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc901498000/0xaa4c98508c49881f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498826 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178971.851758:0:6587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc901498000/0xaa4c98508c49881f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498826 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788178971.851895:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471961600:0@lo:501: 00000100:00100000:3.0:1788178971.851928:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178971.851960:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9054b4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788178971.852094:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471961600 00000100:00100000:0.0:1788178971.852099:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471961600 00000100:00100000:0.0:1788178971.852131:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788178971.852137:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+12:6587:x1875041471961600:12345-0@lo:501: 00000100:00100000:0.0:1788178971.852346:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+12:6587:x1875041471961600:12345-0@lo:501: Request processed in 209us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178971.852353:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788178971.853521:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471961472:0@lo:103: 00000100:00100000:1.0:1788178971.853570:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178971.853726:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471961472 00000100:00100000:0.0:1788178971.853733:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471961472 00000100:00100000:0.0:1788178971.853775:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788178971.853782:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efc6f743-3303-46d5-8807-513b82cac1cc+12:3308:x1875041471961472:12345-0@lo:103: 00010000:00010000:0.0:1788178971.853793:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788178971.853815:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc942172200/0xaa4c98508c49880a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa4c98508c498803 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.853830:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788178971.853873:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efc6f743-3303-46d5-8807-513b82cac1cc+11:3308:x1875041471961472:12345-0@lo:103: Request processed in 92us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178971.853879:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788178971.853906:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471961472:0@lo:103: 00000100:00100000:3.0:1788178971.854058:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471961600:0@lo:501: 00000100:00100000:3.0:1788178971.854090:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471961728:0@lo:503: 00000100:00100000:3.0:1788178971.854129:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178971.854157:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9054b4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788178971.854203:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471961728 00000100:00100000:1.0:1788178971.854207:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471961728 00000100:00100000:1.0:1788178971.854233:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788178971.854239:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+11:6587:x1875041471961728:12345-0@lo:503: 00000100:00100000:1.0:1788178971.854413:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+11:6587:x1875041471961728:12345-0@lo:503: Request processed in 173us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178971.854420:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788178971.854592:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471961728:0@lo:503: 00000040:00080000:3.0:1788178971.854892:0:6587:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788178971.854948:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471961856:0@lo:502: 00000100:00100000:3.0:1788178971.854980:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178971.854996:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9054b4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788178971.855513:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471961856 00000100:00100000:1.0:1788178971.855520:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471961856 00000100:00100000:1.0:1788178971.855557:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788178971.855565:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+11:6587:x1875041471961856:12345-0@lo:502: 00000100:00100000:1.0:1788178971.855713:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+11:6587:x1875041471961856:12345-0@lo:502: Request processed in 148us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178971.855720:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788178971.856527:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471961856:0@lo:502: 00000040:00080000:3.0:1788178971.856962:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788178971.857017:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788178971.857049:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788178971.857104:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788178971.857139:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788178971.857173:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788178971.857203:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471961984:0@lo:502: 00000100:00100000:3.0:1788178971.857253:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178971.857280:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9054b4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788178971.857346:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471961984 00000100:00100000:1.0:1788178971.857352:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471961984 00000100:00100000:1.0:1788178971.857403:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788178971.857411:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+11:6587:x1875041471961984:12345-0@lo:502: 00000100:00100000:1.0:1788178971.857585:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+11:6587:x1875041471961984:12345-0@lo:502: Request processed in 174us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178971.857593:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788178971.858572:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471961984:0@lo:502: 00000040:00080000:3.0:1788178971.858677:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788178971.858696:0:6587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1788178971.864960:0:6609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788178971.864973:0:6609:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788178971.864986:0:6609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788178971.864988:0:6609:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788178971.864994:0:6609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788178971.865010:0:6609:0:(genops.c:414:class_newdev()) Allocate new device lustre-OST0000 (ffff9bc93abc4d40) 00000020:00000080:1.0:1788178971.865031:0:6609:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788178971.865036:0:6609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788178971.865093:0:6609:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bc913608800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788178971.865101:0:6609:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788178971.865107:0:6609:0:(genops.c:1407:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xaa4c98508c498834 00010000:00010000:2.0:1788178971.898054:0:6609:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788178971.898368:0:6609:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788178971.905677:0:6609:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788178971.906015:0:6609:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788178971.906583:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1788178971.915269:0:6609:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788178971.917972:0:6609:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788178971.932936:0:6609:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788178971.932948:0:6609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788178971.932954:0:6609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788178971.932957:0:6609:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788178971.932961:0:6609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788178971.932964:0:6609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788178971.932966:0:6609:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788178971.932969:0:6609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788178971.932970:0:6609:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788178971.933025:0:6609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788178971.933029:0:6609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788178971.933031:0:6609:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788178971.933034:0:6609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788178971.936747:0:6587:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788178971.936785:0:6587:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788178971.936816:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc901498000/0xaa4c98508c49881f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498826 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178971.936829:0:6587:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc901498000/0xaa4c98508c49881f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498826 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788178971.936838:0:6587:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bc913608800 from 1 10000000:01000000:3.0:1788178971.936840:0:6587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788178971.936893:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc901499e00/0xaa4c98508c49883b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178971.936901:0:6587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc901499e00/0xaa4c98508c49883b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178971.936910:0:6587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc901499e00/0xaa4c98508c49883b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788178971.936931:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471962112:0@lo:101: 00000100:00100000:3.0:1788178971.936994:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178971.937037:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9054b4840 going to sleep for 11 seconds 00000100:00100000:0.0:1788178971.937175:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471962112 00000100:00100000:0.0:1788178971.937183:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471962112 00000100:00100000:0.0:1788178971.937226:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788178971.937235:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+11:6587:x1875041471962112:12345-0@lo:101: 00010000:00010000:0.0:1788178971.937258:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788178971.937270:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc900030a00/0xaa4c98508c498842 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c49883b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.937292:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc900030a00/0xaa4c98508c498842 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c49883b expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.937303:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc900030a00/0xaa4c98508c498842 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c49883b expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178971.937311:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc900030a00, rc 0) 00000100:00100000:0.0:1788178971.937348:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+12:6587:x1875041471962112:12345-0@lo:101: Request processed in 115us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178971.937356:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788178971.937636:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471962112:0@lo:101: 00010000:00010000:3.0:1788178971.937651:0:6587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc901499e00/0xaa4c98508c49883b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498842 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178971.937671:0:6587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc901499e00/0xaa4c98508c49883b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498842 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788178971.937769:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471962240:0@lo:501: 00000100:00100000:3.0:1788178971.937808:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178971.937832:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9054b4840 going to sleep for 11 seconds 00000100:00100000:0.0:1788178971.938266:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471962240 00000100:00100000:0.0:1788178971.938272:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471962240 00000100:00100000:0.0:1788178971.938309:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788178971.938318:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+12:6587:x1875041471962240:12345-0@lo:501: 00000100:00100000:0.0:1788178971.938564:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+12:6587:x1875041471962240:12345-0@lo:501: Request processed in 246us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178971.938572:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788178971.938749:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471962240:0@lo:501: 00000100:00100000:3.0:1788178971.938782:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471962368:0@lo:503: 00000100:00100000:3.0:1788178971.938831:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178971.938884:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9054b4840 going to sleep for 11 seconds 00000100:00100000:0.0:1788178971.938988:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471962368 00000100:00100000:0.0:1788178971.938992:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471962368 00000100:00100000:0.0:1788178971.939024:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788178971.939031:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+12:6587:x1875041471962368:12345-0@lo:503: 00000100:00100000:0.0:1788178971.939213:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+12:6587:x1875041471962368:12345-0@lo:503: Request processed in 182us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178971.939220:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788178971.939265:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471962368:0@lo:503: 00000040:00080000:0.0:1788178971.939670:0:6587:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788178971.939732:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471962496:0@lo:502: 00000100:00100000:0.0:1788178971.939765:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178971.939778:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9265446c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788178971.941236:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471962496 00000100:00100000:3.0:1788178971.941246:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471962496 00000100:00100000:3.0:1788178971.941293:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788178971.941302:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+12:6587:x1875041471962496:12345-0@lo:502: 00000100:00100000:3.0:1788178971.941628:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+12:6587:x1875041471962496:12345-0@lo:502: Request processed in 327us (1862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178971.941637:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788178971.942124:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471962496:0@lo:502: 00000040:00080000:0.0:1788178971.942671:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788178971.942723:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788178971.942755:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471962624:0@lo:502: 00000100:00100000:0.0:1788178971.942979:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178971.943021:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9265446c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788178971.943067:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471962624 00000100:00100000:3.0:1788178971.943073:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471962624 00000100:00100000:3.0:1788178971.943112:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788178971.943119:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+12:6587:x1875041471962624:12345-0@lo:502: 00000100:00100000:3.0:1788178971.943269:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+12:6587:x1875041471962624:12345-0@lo:502: Request processed in 149us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178971.943276:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788178971.943357:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471962624:0@lo:502: 00000040:00080000:0.0:1788178971.943562:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788178971.943571:0:6587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788178971.954291:0:6613:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788178971.954305:0:6613:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788178971.954308:0:6613:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788178971.954315:0:6613:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bc913608800 00000020:00000080:1.0:1788178971.954318:0:6613:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788178971.954337:0:6613:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788178971.954340:0:6613:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788178971.954341:0:6613:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788178971.954344:0:6613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788178971.960967:0:6587:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788178971.961011:0:6587:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788178971.961028:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc901499e00/0xaa4c98508c49883b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498842 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178971.961041:0:6587:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc901499e00/0xaa4c98508c49883b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498842 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788178971.961085:0:6587:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788178971.961088:0:6587:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bc913608800 10000000:01000000:1.0:1788178971.961091:0:6587:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bc913608800 10000000:01000000:1.0:1788178971.961094:0:6587:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788178971.961100:0:6587:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9bc913608800 from 1 10000000:01000000:1.0:1788178971.961104:0:6587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788178971.961149:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c498849 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178971.961157:0:6587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c498849 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178971.961168:0:6587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c498849 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178971.961189:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bf9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471962752:0@lo:101: 00000100:00100000:1.0:1788178971.961247:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178971.961299:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9266da6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788178971.961358:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471962752 00000100:00100000:3.0:1788178971.961370:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471962752 00000100:00100000:3.0:1788178971.961430:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788178971.961439:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+12:6587:x1875041471962752:12345-0@lo:101: 00010000:00010000:3.0:1788178971.961451:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788178971.961474:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc901498400/0xaa4c98508c498850 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c498849 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178971.961496:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc901498400/0xaa4c98508c498850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c498849 expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178971.961507:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc901498400/0xaa4c98508c498850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498849 expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178971.961515:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc901498400, rc 0) 00000100:00100000:3.0:1788178971.961557:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+13:6587:x1875041471962752:12345-0@lo:101: Request processed in 119us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178971.961563:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788178971.961607:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bf9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471962752:0@lo:101: 00010000:00010000:3.0:1788178971.961620:0:6587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c498849 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498850 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178971.961628:0:6587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c498849 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498850 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788178971.961714:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471962880:0@lo:501: 00000100:00100000:3.0:1788178971.961739:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178971.961754:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9054b4780 going to sleep for 11 seconds 00000100:00100000:1.0:1788178971.962270:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471962880 00000100:00100000:1.0:1788178971.962276:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471962880 00000100:00100000:1.0:1788178971.962309:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788178971.962316:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+13:6587:x1875041471962880:12345-0@lo:501: 00000100:00100000:1.0:1788178971.962570:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+13:6587:x1875041471962880:12345-0@lo:501: Request processed in 253us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178971.962577:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788178971.962943:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471962880:0@lo:501: 00000100:00100000:2.0:1788178971.962980:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471963008:0@lo:503: 00000100:00100000:2.0:1788178971.963021:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788178971.963047:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93fb0cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788178971.963165:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471963008 00000100:00100000:3.0:1788178971.963171:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471963008 00000100:00100000:3.0:1788178971.963198:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788178971.963205:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+13:6587:x1875041471963008:12345-0@lo:503: 00000100:00100000:3.0:1788178971.963353:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+13:6587:x1875041471963008:12345-0@lo:503: Request processed in 148us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178971.963360:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788178971.963539:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471963008:0@lo:503: 00000040:00080000:2.0:1788178971.963816:0:6587:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788178971.963926:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471963136:0@lo:502: 00000100:00100000:2.0:1788178971.963960:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788178971.963974:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93fb0cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788178971.964108:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471963136 00000100:00100000:1.0:1788178971.964113:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471963136 00000100:00100000:1.0:1788178971.964133:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788178971.964140:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+13:6587:x1875041471963136:12345-0@lo:502: 00000100:00100000:1.0:1788178971.964294:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+13:6587:x1875041471963136:12345-0@lo:502: Request processed in 154us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178971.964301:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788178971.966028:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471963136:0@lo:502: 00000040:00080000:2.0:1788178971.966353:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788178971.969327:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788178971.969399:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788178971.969487:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788178971.969536:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788178971.969575:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788178971.969625:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788178971.969654:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788178971.969695:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788178971.969728:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788178971.969760:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788178971.969822:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788178971.969894:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788178971.969930:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788178971.969971:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788178971.969999:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788178971.970024:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788178971.970060:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788178971.970102:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788178971.970128:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788178971.970166:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788178971.970193:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788178971.970232:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788178971.970752:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788178971.970787:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788178971.973261:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788178971.973323:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788178971.973356:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1788178971.984299:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bfb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471963264:0@lo:502: 00000100:00100000:3.0:1788178971.985120:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178971.985210:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9054b4480 going to sleep for 11 seconds 00000100:00100000:1.0:1788178971.989275:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471963264 00000100:00100000:1.0:1788178971.989292:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471963264 00000100:00100000:0.0:1788178971.992686:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788178971.992701:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+13:6587:x1875041471963264:12345-0@lo:502: 00000100:00100000:0.0:1788178971.993035:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+13:6587:x1875041471963264:12345-0@lo:502: Request processed in 337us (7914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178971.993043:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788178971.993180:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bfb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471963264:0@lo:502: 00000040:00080000:2.0:1788178971.993286:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788178971.993302:0:6587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788178971.994319:0:6614:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788178971.994347:0:6614:0:(genops.c:414:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9bc93fb3b380) 00000020:00000080:1.0:1788178971.994369:0:6614:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1788178971.994655:0:6614:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bc913608800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788178971.994660:0:6614:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bc913608800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788178971.994662:0:6614:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bc913608800 3 00010000:00080000:1.0:1788178971.994689:0:6614:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bc93fb40000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.102@tcp at head 00010000:00010000:2.0:1788178972.002520:0:6614:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1788178972.002618:0:6614:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788178972.002658:0:6614:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788178972.002670:0:6614:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xaa4c98508c49885e 00000100:00080000:2.0:1788178972.002680:0:6614:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788178972.002690:0:6614:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bc93fb40000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:2.0:1788178972.002723:0:6614:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bc910b9d500 x1875041471963392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788178972.002746:0:6614:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788178972.003595:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041471963520:0@lo:400: 00000100:00100000:3.0:1788178972.003663:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178972.003735:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471963520 00000100:00100000:3.0:1788178972.003741:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471963520 00000100:00100000:3.0:1788178972.003782:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788178972.003804:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041471963520:12345-0@lo:400: 00000100:00100000:3.0:1788178972.003873:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041471963520:12345-0@lo:400: Request processed in 82us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178972.003881:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788178972.003923:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc93539e300 x1875041471963520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788178988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788178972.003937:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041471963520:0@lo:400: 00000100:00100000:0.0:1788178972.004018:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875041471963392:0@lo:38: 00000100:00100000:0.0:1788178972.004051:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178972.004337:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471963392 00000100:00100000:3.0:1788178972.004342:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471963392 00000100:00100000:3.0:1788178972.004377:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788178972.004390:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875041471963392:12345-0@lo:38: 00010000:00080000:3.0:1788178972.004409:0:5796:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:3.0:1788178972.004440:0:5796:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xaa4c98508c498865 00000004:00100000:3.0:1788178972.004472:0:5796:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788178972.004500:0:5796:0:(import.c:65:import_set_state_nolock()) ffff9bc93abd0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788178972.004540:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875041471963392:12345-0@lo:38: Request processed in 149us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178972.004546:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788178972.004704:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc910b9d500 x1875041471963392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788178982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788178972.004713:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788178972.004720:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788178972.004733:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788178972.004737:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788178972.004740:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9bc93fb40000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788178972.004745:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875041471963392:0@lo:38: 00000040:00080000:3.0:1788178972.006766:0:6614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1788178972.007059:0:6587:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788178972.007096:0:6587:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788178972.007114:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c498849 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498850 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178972.007127:0:6587:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c498849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498850 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788178972.007179:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788178972.007181:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788178972.007183:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788178972.007184:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788178972.007186:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788178972.007187:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788178972.007189:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788178972.007190:0:6587:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788178972.007192:0:6587:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788178972.007194:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788178972.007195:0:6587:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788178972.007199:0:6587:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788178972.007201:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788178972.007203:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788178972.007204:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788178972.007205:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788178972.007206:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788178972.007207:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788178972.007208:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788178972.007209:0:6587:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788178972.007210:0:6587:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788178972.007211:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788178972.007212:0:6587:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788178972.007240:0:6587:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788178972.007258:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471963648:0@lo:253: 00000100:00100000:2.0:1788178972.007318:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788178972.007355:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93fb0c240 going to sleep for 11 seconds 00000100:00100000:1.0:1788178972.007659:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471963648 00000100:00100000:1.0:1788178972.007667:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471963648 00000100:00100000:1.0:1788178972.007715:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788178972.007725:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+13:6587:x1875041471963648:12345-0@lo:253: 20000000:01000000:1.0:1788178972.007750:0:5790:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788178972.007763:0:5790:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788178972.105508:0:5790:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788178972.105531:0:5790:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788178972.105589:0:5812:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788178972.105595:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788178972.105616:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bc900030e00/0xaa4c98508c49886c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178972.105634:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc900031600/0xaa4c98508c4987cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c4987c4 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178972.105643:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bc900030e00/0xaa4c98508c49886c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178972.105680:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc900031600/0xaa4c98508c4987cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c4987c4 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178972.105693:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bc900031600/0xaa4c98508c4987cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c4987c4 expref: 13 pid: 5790 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788178972.105707:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abb9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1875041471963776:0@lo:104: 00000100:00100000:0.0:1788178972.105770:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178972.105841:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc926544c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788178972.105998:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471963776 00000100:00100000:1.0:1788178972.106006:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471963776 00000100:00100000:1.0:1788178972.106061:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788178972.106080:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efc6f743-3303-46d5-8807-513b82cac1cc+3:5812:x1875041471963776:12345-0@lo:104: 00010000:00010000:1.0:1788178972.106094:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc901499600/0xaa4c98508c4987c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c4987cb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178972.106148:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788178972.106154:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efc6f743-3303-46d5-8807-513b82cac1cc+3:5812:x1875041471963776:12345-0@lo:104: Request processed in 77us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178972.106161:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788178972.106198:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788178972.106203:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc901499600/0xaa4c98508c4987c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c4987cb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178972.106211:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc901499600 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:1.0:1788178972.106215:0:6606:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc901499600/0xaa4c98508c4987c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c4987cb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178972.106225:0:6606:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc901499600/0xaa4c98508c4987c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c4987cb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788178972.106249:0:6606:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc901499600/0xaa4c98508c4987c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c4987cb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788178972.106256:0:6606:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788178972.106284:0:6606:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc901499600/0xaa4c98508c4987c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c4987cb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178972.106291:0:6606:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788178972.106311:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc901499600/0xaa4c98508c4987c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c4987cb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178972.106319:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc901499600/0xaa4c98508c4987c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c4987cb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178972.106336:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788178972.106338:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788178972.106339:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788178972.106356:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041471963904:0@lo:103: 00000100:00100000:1.0:1788178972.106399:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178972.106436:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471963904 00000100:00100000:1.0:1788178972.106440:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471963904 00010000:00010000:1.0:1788178972.106458:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc900031600/0xaa4c98508c4987cb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c4987c4 expref: 14 pid: 5790 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178972.106491:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788178972.106498:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc905f66850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efc6f743-3303-46d5-8807-513b82cac1cc+14:3306:x1875041471963904:12345-0@lo:103: 00010000:00010000:1.0:1788178972.106508:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788178972.106513:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc900031600/0xaa4c98508c4987cb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c4987c4 expref: 14 pid: 5790 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178972.106528:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc900031600/0xaa4c98508c4987cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c4987c4 expref: 14 pid: 5790 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178972.106544:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bc900030e00/0xaa4c98508c49886c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178972.106552:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc900030e00/0xaa4c98508c49886c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788178972.106565:0:5783:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001745849s 00010000:00010000:1.0:1788178972.106569:0:5783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bc900030e00/0xaa4c98508c49886c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178972.106577:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bc900030e00/0xaa4c98508c49886c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178972.106584:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bc900030e00/0xaa4c98508c49886c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178972.106591:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bc900030e00/0xaa4c98508c49886c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178972.106597:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc900030e00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:1.0:1788178972.106600:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bc900030e00/0xaa4c98508c49886c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178972.106607:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bc900030e00/0xaa4c98508c49886c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178972.106615:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bc900030e00/0xaa4c98508c49886c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178972.106634:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788178972.106658:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc905f66850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efc6f743-3303-46d5-8807-513b82cac1cc+14:3306:x1875041471963904:12345-0@lo:103: Request processed in 161us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178972.106665:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788178972.106722:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041471963904:0@lo:103: 00010000:00010000:1.0:1788178972.106748:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc900031600/0xaa4c98508c4987cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c4987c4 expref: 13 pid: 5790 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178972.106758:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abb9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1875041471963776:0@lo:104: 00010000:00010000:1.0:1788178972.106768:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bc900030e00/0xaa4c98508c49886c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178972.106776:0:5812:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bc900030e00/0xaa4c98508c49886c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178972.106783:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bc900030e00/0xaa4c98508c49886c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178972.106789:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc900030e00/0xaa4c98508c49886c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178972.121316:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+12:6587:x1875041471963648:12345-0@lo:253: Request processed in 113582us (113986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178972.121339:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788178972.121539:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:6587:1875041471963648:0@lo:253: 10000000:01000000:2.0:1788178972.121555:0:6587:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788178972.121559:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788178972.121560:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788178972.121561:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788178972.121562:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788178972.121564:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788178972.121565:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788178972.121566:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788178972.121568:0:6587:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788178972.121569:0:6587:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788178972.121570:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788178972.121571:0:6587:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788178972.121591:0:6587:0:(tgt_mount.c:2766:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788178972.136748:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788178972.136996:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788178972.137606:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788178972.137822:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788178972.138057:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788178972.139723:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788178972.145725:0:6587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788178972.558611:0:6587:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788178972.558618:0:6587:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788178972.558648:0:6587:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788178972.558706:0:6587:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.102@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788178972.558722:0:6587:0:(tgt_mount.c:2535:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788178972.558749:0:6587:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788178972.931687:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788178973.951969:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788178974.979959:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788178976.002565:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788178976.959950:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788178976.959958:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9bc9070e2800 from 21 10000000:01000000:1.0:1788178976.959965:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788178976.960027:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c498873 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178976.960039:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c498873 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178976.960050:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c498873 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178976.960074:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bfa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471964032:0@lo:101: 00000100:00100000:1.0:1788178976.960150:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178976.960207:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9094d9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788178976.960292:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471964032 00000100:00100000:3.0:1788178976.960300:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471964032 00000100:00100000:3.0:1788178976.960359:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788178976.960369:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+12:5793:x1875041471964032:12345-0@lo:101: 00010000:00010000:3.0:1788178976.960382:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788178976.960396:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc901499600/0xaa4c98508c49887a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c498873 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178976.960427:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc901499600/0xaa4c98508c49887a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c498873 expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178976.960438:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc901499600/0xaa4c98508c49887a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498873 expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178976.960446:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc901499600, rc 0) 00000100:00100000:3.0:1788178976.960485:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+13:5793:x1875041471964032:12345-0@lo:101: Request processed in 117us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178976.960491:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788178976.961154:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bfa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471964032:0@lo:101: 00010000:00010000:1.0:1788178976.961173:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c498873 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c49887a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178976.961183:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c498873 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c49887a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178976.961242:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bfa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471964160:0@lo:501: 00000100:00100000:1.0:1788178976.961272:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178976.961308:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9094d9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788178976.961576:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471964160 00000100:00100000:3.0:1788178976.961583:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471964160 00000100:00100000:3.0:1788178976.961617:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788178976.961624:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+13:5793:x1875041471964160:12345-0@lo:501: 00000100:00100000:3.0:1788178976.962033:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+13:5793:x1875041471964160:12345-0@lo:501: Request processed in 408us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178976.962040:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788178976.962205:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bfa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471964160:0@lo:501: 00000100:00100000:0.0:1788178976.962245:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abbb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471964288:0@lo:503: 00000100:00100000:0.0:1788178976.962286:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178976.962401:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9357d76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788178976.975505:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471964288 00000100:00100000:2.0:1788178976.975524:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471964288 00000100:00100000:2.0:1788178976.975588:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788178976.975599:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+13:5793:x1875041471964288:12345-0@lo:503: 00000100:00100000:2.0:1788178976.976068:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+13:5793:x1875041471964288:12345-0@lo:503: Request processed in 468us (13779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788178976.976075:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788178976.976162:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abbb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471964288:0@lo:503: 00000100:00100000:2.0:1788178976.976494:0:6797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:6797:1875041471964416:0@lo:502: 00000100:00100000:2.0:1788178976.976539:0:6797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788178976.976564:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471964416 00000100:00100000:2.0:1788178976.976569:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471964416 00000100:00100000:2.0:1788178976.976593:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788178976.976600:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+13:6797:x1875041471964416:12345-0@lo:502: 00000100:00100000:2.0:1788178976.976805:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+13:6797:x1875041471964416:12345-0@lo:502: Request processed in 205us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788178976.976812:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788178976.976895:0:6797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92654b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788178976.976912:0:6797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:6797:1875041471964416:0@lo:502: 00000100:00100000:2.0:1788178976.976956:0:6797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:6797:1875041471964544:0@lo:502: 00000100:00100000:2.0:1788178976.976986:0:6797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788178976.977006:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471964544 00000100:00100000:2.0:1788178976.977010:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471964544 00000100:00100000:2.0:1788178976.977028:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788178976.977033:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+13:6797:x1875041471964544:12345-0@lo:502: 00000100:00100000:2.0:1788178976.977139:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+13:6797:x1875041471964544:12345-0@lo:502: Request processed in 105us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788178976.977151:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788178976.977177:0:6797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9054b4000 going to sleep for 11 seconds 00000100:00100000:2.0:1788178976.977188:0:6797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:6797:1875041471964544:0@lo:502: 00000040:00080000:2.0:1788178976.977206:0:6797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1788178976.977261:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788178976.977280:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788178976.977290:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c498873 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c49887a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178976.977300:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c498873 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c49887a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788178976.977309:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788178976.977312:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9bc9070e2800 from 4 10000000:01000000:2.0:1788178976.977315:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788178976.977342:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c498881 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178976.977351:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c498881 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178976.977361:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c498881 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788178976.977372:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471964672:0@lo:101: 00000100:00100000:2.0:1788178976.977395:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788178976.977407:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9054b4000 going to sleep for 11 seconds 00000100:00100000:2.0:1788178976.977433:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471964672 00000100:00100000:2.0:1788178976.977437:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471964672 00000100:00100000:2.0:1788178976.977462:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788178976.977469:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90353a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+13:5793:x1875041471964672:12345-0@lo:101: 00010000:00010000:2.0:1788178976.977478:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788178976.977492:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc942172e00/0xaa4c98508c498888 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c498881 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178976.977512:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc942172e00/0xaa4c98508c498888 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c498881 expref: 14 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178976.977522:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc942172e00/0xaa4c98508c498888 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498881 expref: 14 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178976.977530:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc942172e00, rc 0) 00000100:00100000:2.0:1788178976.977558:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90353a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+14:5793:x1875041471964672:12345-0@lo:101: Request processed in 89us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788178976.977564:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788178976.977595:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471964672:0@lo:101: 00010000:00010000:2.0:1788178976.977606:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c498881 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498888 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178976.977615:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c498881 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498888 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788178976.977653:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471964800:0@lo:256: 00000100:00100000:2.0:1788178976.977682:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788178976.977694:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9054b4000 going to sleep for 11 seconds 00000100:00100000:2.0:1788178976.977705:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471964800 00000100:00100000:2.0:1788178976.977709:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471964800 00000100:00100000:2.0:1788178976.977727:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788178976.977738:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc903538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+14:5793:x1875041471964800:12345-0@lo:256: 20000000:01000000:2.0:1788178976.977750:0:5789:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788178976.977766:0:5789:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788178976.977770:0:5789:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788178976.977870:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc903538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+14:5793:x1875041471964800:12345-0@lo:256: Request processed in 108us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788178976.977892:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788178976.977924:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471964800:0@lo:256: 10000000:01000000:2.0:1788178976.977963:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788178976.977969:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c498881 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498888 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178976.977976:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c498881 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498888 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788178976.977983:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788178976.977985:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788178976.977988:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788178976.978002:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc942172200/0xaa4c98508c49888f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178976.978009:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc942172200/0xaa4c98508c49888f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178976.978017:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc942172200/0xaa4c98508c49888f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788178976.978030:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471964928:0@lo:101: 00000100:00100000:2.0:1788178976.978052:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788178976.978071:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9054b4000 going to sleep for 11 seconds 00000100:00100000:2.0:1788178976.978082:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471964928 00000100:00100000:2.0:1788178976.978086:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471964928 00000100:00100000:2.0:1788178976.978105:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788178976.978111:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90353b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+14:5793:x1875041471964928:12345-0@lo:101: 00010000:00010000:2.0:1788178976.978117:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788178976.978125:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc942173000/0xaa4c98508c498896 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c49888f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178976.978139:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc942173000/0xaa4c98508c498896 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c49888f expref: 15 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178976.978147:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc942173000/0xaa4c98508c498896 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c49888f expref: 15 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178976.978154:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc942173000, rc 0) 00000100:00100000:2.0:1788178976.978179:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90353b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+15:5793:x1875041471964928:12345-0@lo:101: Request processed in 69us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788178976.978185:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788178976.978211:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471964928:0@lo:101: 00010000:00010000:2.0:1788178976.978221:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc942172200/0xaa4c98508c49888f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498896 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178976.978228:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc942172200/0xaa4c98508c49888f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498896 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788178976.978265:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471965056:0@lo:501: 00000100:00100000:2.0:1788178976.978285:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788178976.978297:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9054b4000 going to sleep for 11 seconds 00000100:00100000:2.0:1788178976.978312:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471965056 00000100:00100000:2.0:1788178976.978315:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471965056 00000100:00100000:2.0:1788178976.978335:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788178976.978341:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc903538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+15:5793:x1875041471965056:12345-0@lo:501: 00000100:00100000:2.0:1788178976.986716:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc903538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+15:5793:x1875041471965056:12345-0@lo:501: Request processed in 8365us (8419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788178976.986731:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788178976.986930:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471965056:0@lo:501: 00000100:00100000:3.0:1788178976.986987:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471965184:0@lo:503: 00000100:00100000:3.0:1788178976.987036:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178976.987074:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc918346600 going to sleep for 11 seconds 00000100:00100000:2.0:1788178976.987890:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471965184 00000100:00100000:2.0:1788178976.987898:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471965184 00000100:00100000:2.0:1788178976.987940:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788178976.987948:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc903538450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+15:5793:x1875041471965184:12345-0@lo:503: 00000100:00100000:2.0:1788178976.988268:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc903538450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+15:5793:x1875041471965184:12345-0@lo:503: Request processed in 320us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788178976.988275:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788178976.988315:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471965184:0@lo:503: 00000100:00100000:2.0:1788178976.995120:0:6798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:6798:1875041471965312:0@lo:502: 00000100:00100000:2.0:1788178976.995224:0:6798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788178976.995279:0:6798:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9109676c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788178976.995340:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471965312 00000100:00100000:3.0:1788178976.995347:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471965312 00000100:00100000:3.0:1788178976.995394:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788178976.995404:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc903538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+15:6798:x1875041471965312:12345-0@lo:502: 00000100:00100000:3.0:1788178976.995723:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc903538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+15:6798:x1875041471965312:12345-0@lo:502: Request processed in 320us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178976.995731:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788178976.995918:0:6798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:6798:1875041471965312:0@lo:502: 00000020:01000000:2.0:1788178976.995948:0:6798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788178976.995955:0:6798:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788178976.995962:0:6798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788178976.995964:0:6798:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788178976.995968:0:6798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788178976.995972:0:6798:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.102@tcp to nid 0x20000c0a8ca66 (192.168.202.102@tcp) 00000020:01000000:2.0:1788178976.995993:0:6798:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788178976.995995:0:6798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788178976.996014:0:6798:0:(genops.c:414:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9bc905c20000) 00000020:00000080:2.0:1788178976.996033:0:6798:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788178976.996038:0:6798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788178976.996119:0:6798:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788178976.996125:0:6798:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788178976.996133:0:6798:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa4c98508c4988a4 00010000:00080000:2.0:1788178976.996161:0:6798:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bc902f15000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.102@tcp at head 00010000:00010000:2.0:1788178976.996392:0:6798:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00010000:00010000:1.0:1788178977.043874:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788178977.169253:0:6798:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788178977.169278:0:6798:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788178977.169875:0:6798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788178977.171139:0:6798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788178977.171193:0:6798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788178977.171253:0:6798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788178977.185192:0:6808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788178977.185202:0:6808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788178977.189197:0:6798:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788178977.189216:0:6798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788178977.189256:0:6798:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788178977.189276:0:6798:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa4c98508c4988ab 00000100:00080000:0.0:1788178977.189286:0:6798:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788178977.189291:0:6798:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bc902f15000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:0.0:1788178977.189328:0:6798:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bc93abb9f80 x1875041471965440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788178977.189350:0:6798:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788178977.189424:0:6798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788178977.189429:0:6798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788178977.189431:0:6798:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788178977.189434:0:6798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788178977.189438:0:6798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788178977.189439:0:6798:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788178977.189442:0:6798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788178977.189444:0:6798:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788178977.189472:0:6798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abbbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:6798:1875041471965568:0@lo:502: 00000100:00100000:0.0:1788178977.189555:0:6798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178977.189612:0:6798:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc910ebe600 going to sleep for 11 seconds 00000100:00100000:0.0:1788178977.189634:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875041471965440:0@lo:8: 00000100:00100000:0.0:1788178977.189667:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178977.189747:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875041471965824:0@lo:400: 00000100:00100000:0.0:1788178977.189774:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178977.189794:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788178977.189799:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875041471965696:0@lo:400: 00000100:00100000:0.0:1788178977.189818:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178977.189881:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471965824 00000100:00100000:0.0:1788178977.189889:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471965824 00000100:00100000:0.0:1788178977.189941:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471965696 00000100:00100000:0.0:1788178977.189951:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471965696 00000100:00100000:0.0:1788178977.189974:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788178977.189981:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875041471965824:12345-0@lo:400: 00000100:00100000:0.0:1788178977.190030:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875041471965824:12345-0@lo:400: Request processed in 49us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178977.190036:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788178977.190050:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788178977.190055:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875041471965696:12345-0@lo:400: 00000100:00100000:0.0:1788178977.190091:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875041471965696:12345-0@lo:400: Request processed in 36us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178977.190098:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788178977.190117:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788178977.190146:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc93abb9880 x1875041471965696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788178993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788178977.190160:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875041471965696:0@lo:400: 00010000:00080000:0.0:1788178977.190172:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc93abbb480 x1875041471965824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788178993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788178977.190179:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875041471965824:0@lo:400: 00000100:00100000:3.0:1788178977.190727:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471965440 00000100:00100000:3.0:1788178977.190733:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471965440 00000100:00100000:3.0:1788178977.190761:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788178977.190766:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1875041471965440:12345-0@lo:8: 00010000:00080000:3.0:1788178977.190789:0:6589:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:3.0:1788178977.190816:0:6589:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa4c98508c4988b2 00002000:00100000:3.0:1788178977.190888:0:6589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9bc913617800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211371b ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788178977.190902:0:6589:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1788178977.190906:0:6589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788178977.191031:0:6589:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788178977.191168:0:6589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788178977.191201:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9bc913617000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788178977.191246:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1875041471965440:12345-0@lo:8: Request processed in 479us (1578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178977.191253:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788178977.191275:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471965568 00000100:00100000:3.0:1788178977.191278:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471965568 00000100:00100000:3.0:1788178977.191304:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788178977.191310:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90353b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+15:6798:x1875041471965568:12345-0@lo:502: 00000100:00100000:3.0:1788178977.191521:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90353b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+15:6798:x1875041471965568:12345-0@lo:502: Request processed in 211us (1965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178977.191528:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1788178977.194168:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc93abb9f80 x1875041471965440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788178987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788178977.194184:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788178977.194194:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788178977.194204:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788178977.194210:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788178977.194213:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9bc902f15000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788178977.195037:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788178977.195057:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875041471965440:0@lo:8: 00000100:00100000:0.0:1788178977.195108:0:6798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abbbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:6798:1875041471965568:0@lo:502: 00000020:01000000:0.0:1788178977.195142:0:6798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788178977.195150:0:6798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788178977.195152:0:6798:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788178977.195157:0:6798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1788178977.196843:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788178977.196880:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788178977.196889:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc942172200/0xaa4c98508c49888f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498896 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178977.196905:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc942172200/0xaa4c98508c49888f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498896 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788178977.196927:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788178977.196930:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9bc9265819c0 from 1 10000000:01000000:1.0:1788178977.196932:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788178977.196967:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c4988b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178977.196975:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c4988b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178977.196985:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c4988b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178977.197005:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bfb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471965952:0@lo:101: 00000100:00100000:1.0:1788178977.197063:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178977.197116:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93213bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788178977.197141:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471965952 00000100:00100000:1.0:1788178977.197147:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471965952 00000100:00100000:1.0:1788178977.197187:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788178977.197195:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc903539c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+15:5793:x1875041471965952:12345-0@lo:101: 00010000:00010000:1.0:1788178977.197208:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788178977.197221:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c4988c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c4988b9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178977.197244:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c4988c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c4988b9 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178977.197255:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c4988c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c4988b9 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178977.197273:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317fc00, rc 0) 00000100:00100000:1.0:1788178977.197312:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc903539c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+16:5793:x1875041471965952:12345-0@lo:101: Request processed in 118us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178977.197319:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788178977.197624:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bfb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471965952:0@lo:101: 00010000:00010000:0.0:1788178977.197637:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c4988b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c4988c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178977.197645:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c4988b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c4988c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788178977.197694:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471966080:0@lo:501: 00000100:00100000:0.0:1788178977.197721:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178977.197736:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc910ebe600 going to sleep for 11 seconds 00000100:00100000:0.0:1788178977.199303:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471966080 00000100:00100000:0.0:1788178977.199314:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471966080 00000100:00100000:0.0:1788178977.199356:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788178977.199365:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+16:5793:x1875041471966080:12345-0@lo:501: 00000100:00100000:0.0:1788178977.199616:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+16:5793:x1875041471966080:12345-0@lo:501: Request processed in 252us (1894us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788178977.199623:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000004:00080000:0.0:1788178977.199654:0:6808:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788178977.199755:0:6808:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 173262904686ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788178977.200048:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471966080:0@lo:501: 10000000:01000000:0.0:1788178977.211580:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788178977.211604:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c4988b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c4988c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178977.211617:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c4988b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c4988c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788178977.303375:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788178977.374692:0:6811:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788178977.374726:0:6811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6811:1875041471966336:0@lo:7: 00000100:00100000:3.0:1788178977.374793:0:6811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178977.374872:0:6811:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9094d9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788178977.374890:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471966208:0@lo:13: 00000100:00100000:3.0:1788178977.374913:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178977.374948:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471966336 00000100:00100000:3.0:1788178977.374954:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471966336 00000100:00100000:3.0:1788178977.374995:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788178977.375003:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6811:x1875041471966336:12345-0@lo:7: 00000100:00080000:0.0:1788178977.379409:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788178977.379451:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471966208 00000100:00100000:0.0:1788178977.379459:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471966208 00000100:00100000:0.0:1788178977.379504:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788178977.379513:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875041471966208:12345-0@lo:13: 00002000:00000024:0.0:1788178977.379544:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788178977.379618:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875041471966208:12345-0@lo:13: Request processed in 106us (4704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178977.379624:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788178977.384060:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc93539ce00 x1875041471966208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788178993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788178977.384091:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471966208:0@lo:13: 00002000:00080000:3.0:1788178977.393019:0:6591:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788178977.393028:0:6591:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788178977.393131:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6811:x1875041471966336:12345-0@lo:7: Request processed in 18124us (18333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178977.393149:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788178977.395315:0:6811:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc93539d180 x1875041471966336/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788178993 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788178977.395338:0:6811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6811:1875041471966336:0@lo:7: 00000004:00080000:0.0:1788178977.395357:0:6811:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788178977.395408:0:6811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abbbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6811:1875041471966464:0@lo:5: 00000100:00100000:0.0:1788178977.395484:0:6811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178977.395533:0:6811:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc910ebe180 going to sleep for 11 seconds 00000100:00100000:0.0:1788178977.395559:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471966464 00000100:00100000:0.0:1788178977.395566:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471966464 00000100:00100000:0.0:1788178977.395607:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788178977.395615:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6811:x1875041471966464:12345-0@lo:5: 00002000:00080000:0.0:1788178977.395640:0:6590:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788178977.395649:0:6590:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788178977.396047:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6811:x1875041471966464:12345-0@lo:5: Request processed in 431us (562us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788178977.396055:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788178977.396099:0:6811:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc93abbbb80 x1875041471966464/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788178993 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788178977.396112:0:6811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abbbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6811:1875041471966464:0@lo:5: 00000004:00080000:0.0:1788178977.396121:0:6811:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788178977.396143:0:6811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abbb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6811:1875041471966592:0@lo:700: 00000100:00100000:0.0:1788178977.396166:0:6811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178977.396182:0:6811:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc910ebe180 going to sleep for 11 seconds 00000100:00100000:0.0:1788178977.399007:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471966592 00000100:00100000:0.0:1788178977.399027:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471966592 00000100:00100000:0.0:1788178977.399129:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788178977.399141:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6811:x1875041471966592:12345-0@lo:700: 00000100:00100000:0.0:1788178977.399200:0:6598:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abb8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6598:1875041471966720:0@lo:700: 00000100:00100000:0.0:1788178977.399260:0:6598:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178977.399294:0:6598:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc910ebea80 going to sleep for 11 seconds 00000100:00100000:2.0:1788178977.399300:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471966720 00000100:00100000:2.0:1788178977.399305:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471966720 00000100:00100000:2.0:1788178977.399343:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788178977.399350:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6598:x1875041471966720:12345-0@lo:700: 40000000:02000000:3.0:1788178977.506655:0:5803:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1788178977.512350:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6598:x1875041471966720:12345-0@lo:700: Request processed in 112991us (113080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178977.512372:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788178977.521685:0:6598:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc93abb8a80 x1875041471966720/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788178993 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788178977.521713:0:6598:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abb8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6598:1875041471966720:0@lo:700: 40000000:02000000:1.0:1788178977.521729:0:6598:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1788178977.663221:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1788178977.663261:0:6618:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788178977.663505:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6811:x1875041471966592:12345-0@lo:700: Request processed in 264363us (267333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788178977.663523:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788178977.664121:0:6811:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc93abbb480 x1875041471966592/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788178993 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788178977.664133:0:6811:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788178977.664152:0:6811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abbb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6811:1875041471966592:0@lo:700: 00000004:02000040:1.0:1788178977.772889:0:6811:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1788178977.787506:0:6811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bf8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6811:1875041471966848:0@lo:5: 00000100:00100000:1.0:1788178977.787575:0:6811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178977.787643:0:6811:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9201459c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788178977.787746:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471966848 00000100:00100000:2.0:1788178977.787755:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471966848 00000100:00100000:2.0:1788178977.787815:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788178977.787825:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6811:x1875041471966848:12345-0@lo:5: 00002000:00080000:0.0:1788178977.809072:0:6591:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788178977.809096:0:6591:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1788178977.819927:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6811:x1875041471966848:12345-0@lo:5: Request processed in 32098us (32345us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788178977.819940:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788178977.820225:0:6811:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc934bf8700 x1875041471966848/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788178993 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788178977.820242:0:6811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bf8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6811:1875041471966848:0@lo:5: 00000004:00080000:2.0:1788178977.820265:0:6811:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1788178978.053871:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788178979.086222:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788178980.104589:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788178980.205509:0:6962:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788178981.120070:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788178982.155732:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788178982.592550:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471967360:0@lo:400: 00000100:00100000:0.0:1788178982.592630:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178982.592706:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788178982.592712:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041471966976:0@lo:400: 00000100:00100000:0.0:1788178982.592745:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178982.592775:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875041471967232:0@lo:400: 00000100:00100000:0.0:1788178982.592796:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178982.592812:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788178982.592817:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875041471967104:0@lo:400: 00000100:00100000:0.0:1788178982.592846:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178982.592888:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471967232 00000100:00100000:0.0:1788178982.592901:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471967232 00000100:00100000:0.0:1788178982.592945:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471967104 00000100:00100000:0.0:1788178982.592947:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471967104 00000100:00100000:0.0:1788178982.592963:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788178982.592971:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875041471967232:12345-0@lo:400: 00000100:00100000:0.0:1788178982.593018:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875041471967232:12345-0@lo:400: Request processed in 47us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178982.593025:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788178982.593040:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788178982.593045:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875041471967104:12345-0@lo:400: 00000100:00100000:0.0:1788178982.593066:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875041471967104:12345-0@lo:400: Request processed in 21us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178982.593071:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788178982.593086:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788178982.593115:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc93539df80 x1875041471967104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788178998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788178982.593129:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875041471967104:0@lo:400: 00010000:00080000:0.0:1788178982.593138:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc93539fb80 x1875041471967232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788178998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788178982.593153:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875041471967232:0@lo:400: 00000100:00100000:3.0:1788178982.593927:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471967360 00000100:00100000:3.0:1788178982.593934:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471967360 00000100:00100000:3.0:1788178982.593970:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788178982.593977:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875041471967360:12345-0@lo:400: 00000100:00100000:3.0:1788178982.594023:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875041471967360:12345-0@lo:400: Request processed in 47us (1394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178982.594030:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788178982.594048:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788178982.594067:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041471967488:0@lo:13: 00000100:00100000:3.0:1788178982.594077:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471966976 00000100:00100000:3.0:1788178982.594081:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471966976 00000100:00100000:3.0:1788178982.594102:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788178982.594109:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+16:3305:x1875041471966976:12345-0@lo:400: 00000100:00100000:1.0:1788178982.594137:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178982.594147:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+16:3305:x1875041471966976:12345-0@lo:400: Request processed in 38us (1400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178982.594155:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788178982.595303:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471967488 00000100:00100000:0.0:1788178982.595313:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471967488 00000100:00100000:0.0:1788178982.595373:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788178982.595382:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875041471967488:12345-0@lo:13: 00002000:00000024:0.0:1788178982.595427:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788178982.595488:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875041471967488:12345-0@lo:13: Request processed in 108us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178982.595505:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788178982.595553:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041471966976:0@lo:400: 00010000:00080000:0.0:1788178982.595568:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc93539f800 x1875041471967360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788178998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788178982.595580:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471967360:0@lo:400: 00010000:00080000:0.0:1788178982.595637:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc910b9c700 x1875041471967488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788178998 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788178982.595651:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041471967488:0@lo:13: 00000001:00080000:0.0:1788178982.695836:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1788178983.168250:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788178984.193394:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788178985.218750:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788178986.240067:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788178987.275824:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788178987.716186:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041471967616:0@lo:400: 00000100:00100000:3.0:1788178987.716266:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178987.716349:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471967616 00000100:00100000:3.0:1788178987.716363:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471967616 00000100:00100000:3.0:1788178987.716410:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788178987.716419:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+16:3307:x1875041471967616:12345-0@lo:400: 00000100:00100000:3.0:1788178987.716473:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+16:3307:x1875041471967616:12345-0@lo:400: Request processed in 55us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178987.716480:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788178987.716529:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041471967616:0@lo:400: 00000100:00100000:0.0:1788178987.723147:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041471967744:0@lo:13: 00000100:00100000:0.0:1788178987.723223:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178987.723273:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788178987.723281:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041471968128:0@lo:400: 00000100:00100000:0.0:1788178987.723879:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178987.723913:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041471967872:0@lo:400: 00000100:00100000:0.0:1788178987.723948:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178987.723968:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788178987.723974:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041471968000:0@lo:400: 00000100:00100000:0.0:1788178987.723995:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178987.724026:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471967744 00000100:00100000:0.0:1788178987.724033:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471967744 00000100:00100000:0.0:1788178987.724086:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788178987.724096:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041471967744:12345-0@lo:13: 00002000:00000024:0.0:1788178987.724132:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788178987.724172:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041471967744:12345-0@lo:13: Request processed in 77us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178987.724180:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788178987.724202:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471968128 00000100:00100000:0.0:1788178987.724206:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471968128 00000100:00100000:0.0:1788178987.724228:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788178987.724234:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041471968128:12345-0@lo:400: 00000100:00100000:0.0:1788178987.724278:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041471968128:12345-0@lo:400: Request processed in 44us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178987.724285:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788178987.724321:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471967872 00000100:00100000:0.0:1788178987.724325:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471967872 00000100:00100000:0.0:1788178987.724356:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471968000 00000100:00100000:0.0:1788178987.724359:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471968000 00000100:00100000:0.0:1788178987.724457:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788178987.724464:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041471967872:12345-0@lo:400: 00000100:00100000:0.0:1788178987.724575:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041471967872:12345-0@lo:400: Request processed in 111us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178987.724582:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788178987.724601:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788178987.724606:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041471968000:12345-0@lo:400: 00000100:00100000:0.0:1788178987.724634:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041471968000:12345-0@lo:400: Request processed in 28us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178987.724640:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788178987.724662:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788178987.724668:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788178987.724712:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc910b9dc00 x1875041471968128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788178987.724724:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788178987.724745:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041471968128:0@lo:400: 00010000:00080000:0.0:1788178987.724758:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc93539f800 x1875041471967744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788178987.724773:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041471967744:0@lo:13: 00010000:00080000:0.0:1788178987.724801:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc910b9e680 x1875041471968000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788178987.724810:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041471968000:0@lo:400: 00010000:00080000:0.0:1788178987.724818:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc910b9ea00 x1875041471967872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788178987.724827:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041471967872:0@lo:400: 00010000:00010000:2.0:1788178988.293712:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788178989.317485:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788178990.342571:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788178991.360037:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788178992.134456:0:7479:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788178992.134460:0:7479:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788178992.134602:0:7479:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9bc902f11000 00000020:01000004:2.0:1788178992.134617:0:7479:0:(tgt_mount.c:2577:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788178992.134630:0:7479:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788178992.134645:0:7479:0:(genops.c:414:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9bc905c23380) 00000020:00000080:2.0:1788178992.134661:0:7479:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788178992.162899:0:7479:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788178992.164753:0:7479:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788178992.226267:0:7479:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788178992.236741:0:7479:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788178992.236776:0:7479:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788178992.236834:0:7479:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788178992.236898:0:7479:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788178992.237235:0:7479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788178992.237247:0:7479:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788178992.237258:0:7479:0:(genops.c:1407:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xaa4c98508c4988ce 00000020:01000004:3.0:1788178992.237266:0:7479:0:(tgt_mount.c:2662:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788178992.237302:0:7479:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.102@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788178992.237306:0:7479:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788178992.237311:0:7479:0:(tgt_mount.c:1875:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788178992.237331:0:7479:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788178992.237335:0:7479:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.102@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788178992.288750:0:7479:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.102@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788178992.288787:0:7479:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.102@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1788178992.288791:0:7479:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788178992.288793:0:7479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788178992.288795:0:7479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788178992.288796:0:7479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788178992.288798:0:7479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788178992.288799:0:7479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788178992.288801:0:7479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788178992.288802:0:7479:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788178992.288803:0:7479:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788178992.288805:0:7479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788178992.288806:0:7479:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788178992.288809:0:7479:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1788178992.288811:0:7479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788178992.288813:0:7479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788178992.288814:0:7479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788178992.288815:0:7479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788178992.288816:0:7479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788178992.288817:0:7479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788178992.288818:0:7479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788178992.288819:0:7479:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788178992.288820:0:7479:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788178992.288821:0:7479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788178992.288822:0:7479:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788178992.291232:0:7479:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788178992.291261:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bf8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471968256:0@lo:253: 00000100:00100000:1.0:1788178992.291355:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178992.291523:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc926544780 going to sleep for 11 seconds 00000100:00100000:0.0:1788178992.292331:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471968256 00000100:00100000:0.0:1788178992.292350:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471968256 00000100:00100000:0.0:1788178992.302417:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788178992.302499:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+16:7479:x1875041471968256:12345-0@lo:253: 20000000:01000000:0.0:1788178992.302544:0:5790:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788178992.302565:0:5790:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788178992.302570:0:5790:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788178992.302573:0:5790:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788178992.304994:0:5790:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788178992.305220:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788178992.305234:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788178992.305284:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788178992.305292:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788178992.305319:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788178992.305360:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788178992.305821:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788178992.305839:0:5790:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.102@tcp 20000000:01000000:0.0:1788178992.305841:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.102@tcp (null) (null) (null) 00000040:00080000:0.0:1788178992.305901:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788178992.305909:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788178992.305946:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788178992.305952:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.102@tcp (null) (null) 00000040:00080000:0.0:1788178992.305983:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788178992.305991:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788178992.306024:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788178992.306073:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788178992.306778:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788178992.306793:0:5790:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.102@tcp 20000000:01000000:0.0:1788178992.306795:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.102@tcp (null) (null) (null) 00000040:00080000:0.0:1788178992.306827:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788178992.306834:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788178992.307308:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788178992.307317:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.102@tcp (null) (null) 00000040:00080000:0.0:1788178992.307350:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788178992.307358:0:5790:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788178992.307416:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788178992.307980:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788178992.308007:0:5790:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788178992.308010:0:5790:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788178992.308017:0:5790:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788178992.308019:0:5790:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788178992.308021:0:5790:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788178992.308034:0:5790:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788178992.308036:0:5790:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788178992.308074:0:5790:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788178992.308077:0:5790:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788178992.308960:0:7481:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788178992.309015:0:7481:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788178992.309077:0:7481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788178992.309553:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1788178992.309596:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1788178992.309630:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1788178992.309642:0:5790:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788178992.309644:0:5790:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788178992.310194:0:7482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788178992.310478:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788178992.310519:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788178992.310579:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788178992.310593:0:5790:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788178992.310595:0:5790:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788178992.311210:0:7483:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788178992.311284:0:7483:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788178992.311340:0:7483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788178992.313008:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788178992.313054:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788178992.313123:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788178992.313137:0:5790:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788178992.313140:0:5790:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788178992.314716:0:7484:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1788178992.314822:0:7484:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1788178992.314887:0:7484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1788178992.315199:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1788178992.315243:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1788178992.315305:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:2.0:1788178992.315323:0:5790:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788178992.315343:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bc9136c5a00/0xaa4c98508c4988d5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178992.315361:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc942172400/0xaa4c98508c498826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c49881f expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178992.315368:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc901498400/0xaa4c98508c498850 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498849 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178992.315386:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc901499600/0xaa4c98508c49887a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498873 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178992.315393:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc942173000/0xaa4c98508c498896 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c49888f expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178992.315400:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c4988c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c4988b9 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178992.315407:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bc9136c5a00/0xaa4c98508c4988d5 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178992.315447:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c4988c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c4988b9 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178992.315463:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c4988c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c4988b9 expref: 16 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788178992.315476:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5790:1875041471968384:0@lo:104: 00000100:00100000:2.0:1788178992.315540:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788178992.315589:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc942173000/0xaa4c98508c498896 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c49888f expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178992.315598:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bc942173000/0xaa4c98508c498896 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c49888f expref: 16 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788178992.315606:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5790:1875041471968512:0@lo:104: 00010000:00010000:2.0:1788178992.315631:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc901499600/0xaa4c98508c49887a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c498873 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178992.315649:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bc901499600/0xaa4c98508c49887a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c498873 expref: 16 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788178992.315658:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5790:1875041471968640:0@lo:104: 00010000:00010000:2.0:1788178992.315693:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc901498400/0xaa4c98508c498850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c498849 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178992.315701:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bc901498400/0xaa4c98508c498850 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c498849 expref: 16 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788178992.315709:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5790:1875041471968768:0@lo:104: 00010000:00010000:2.0:1788178992.315730:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc942172400/0xaa4c98508c498826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c49881f expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178992.315738:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bc942172400/0xaa4c98508c498826 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c49881f expref: 16 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788178992.315745:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5790:1875041471968896:0@lo:104: 00000100:00100000:2.0:1788178992.315761:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc926545000 going to sleep for 11 seconds 00000100:00100000:0.0:1788178992.316017:0:5780:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788178992.316037:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178992.316064:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178992.316075:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178992.316083:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178992.316093:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471968384 00000100:00100000:0.0:1788178992.316100:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471968384 00000100:00100000:0.0:1788178992.316132:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471968512 00000100:00100000:0.0:1788178992.316135:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471968512 00000100:00100000:0.0:1788178992.316145:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471968640 00000100:00100000:0.0:1788178992.316147:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471968640 00000100:00100000:0.0:1788178992.316155:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471968768 00000100:00100000:0.0:1788178992.316156:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471968768 00000100:00100000:0.0:1788178992.316163:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471968896 00000100:00100000:0.0:1788178992.316166:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471968896 00000100:00100000:0.0:1788178992.316178:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788178992.316199:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9067c4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+7:5790:x1875041471968384:12345-0@lo:104: 00010000:00010000:0.0:1788178992.316211:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c4988b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c4988c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.316285:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788178992.316292:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9067c4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+7:5790:x1875041471968384:12345-0@lo:104: Request processed in 95us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178992.316299:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788178992.316344:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788178992.316351:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+6:5790:x1875041471968512:12345-0@lo:104: 00010000:00010000:0.0:1788178992.316359:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc942172200/0xaa4c98508c49888f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498896 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.316391:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788178992.316396:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+6:5790:x1875041471968512:12345-0@lo:104: Request processed in 47us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178992.316402:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788178992.316415:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788178992.316421:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+5:5790:x1875041471968640:12345-0@lo:104: 00010000:00010000:0.0:1788178992.316428:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c498873 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c49887a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.316458:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788178992.316463:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+5:5790:x1875041471968640:12345-0@lo:104: Request processed in 44us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178992.316468:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788178992.316481:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788178992.316486:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+4:5790:x1875041471968768:12345-0@lo:104: 00010000:00010000:0.0:1788178992.316493:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c498849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498850 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.316531:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788178992.316535:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+4:5790:x1875041471968768:12345-0@lo:104: Request processed in 50us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178992.316541:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788178992.316555:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788178992.316560:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+3:5790:x1875041471968896:12345-0@lo:104: 00010000:00010000:0.0:1788178992.316567:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc901498000/0xaa4c98508c49881f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498826 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.316591:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788178992.316595:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+3:5790:x1875041471968896:12345-0@lo:104: Request processed in 35us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178992.316600:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788178992.316619:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788178992.316625:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c4988b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c4988c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.316632:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317ee00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1788178992.316635:0:6606:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c4988b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c4988c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.316643:0:6606:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c4988b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c4988c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788178992.316650:0:6606:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c4988b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c4988c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788178992.316656:0:6606:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788178992.316691:0:6606:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c4988b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c4988c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.316698:0:6606:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788178992.316714:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c4988b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c4988c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.316722:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c4988b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c4988c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.316749:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788178992.316752:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc942172200/0xaa4c98508c49888f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498896 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.316757:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc942172200 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1788178992.316760:0:6606:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc942172200/0xaa4c98508c49888f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c498896 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.316766:0:6606:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc942172200/0xaa4c98508c49888f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c498896 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788178992.316772:0:6606:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc942172200/0xaa4c98508c49888f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c498896 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788178992.316776:0:6606:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788178992.316787:0:6606:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc942172200/0xaa4c98508c49888f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498896 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.316792:0:6606:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788178992.316805:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc942172200/0xaa4c98508c49888f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498896 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.316821:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc942172200/0xaa4c98508c49888f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498896 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.316831:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788178992.316834:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c498873 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c49887a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.316840:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317e200 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1788178992.316843:0:6606:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c498873 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c49887a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.316873:0:6606:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c498873 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c49887a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788178992.316879:0:6606:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c498873 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c49887a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788178992.316884:0:6606:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788178992.316897:0:6606:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c498873 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c49887a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.316903:0:6606:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788178992.316908:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c498873 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c49887a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.316914:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c498873 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c49887a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.316922:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788178992.316930:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c498849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498850 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.316935:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f400 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1788178992.316939:0:6606:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c498849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c498850 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.316946:0:6606:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c498849 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c498850 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788178992.316953:0:6606:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c498849 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c498850 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788178992.316958:0:6606:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788178992.316970:0:6606:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c498849 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498850 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.316976:0:6606:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788178992.316981:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c498849 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498850 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.316987:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c498849 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498850 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.316996:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788178992.316999:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc901498000/0xaa4c98508c49881f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498826 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.317004:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc901498000 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1788178992.317007:0:6606:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc901498000/0xaa4c98508c49881f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c498826 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.317023:0:6606:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc901498000/0xaa4c98508c49881f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c498826 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788178992.317029:0:6606:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc901498000/0xaa4c98508c49881f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c498826 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788178992.317034:0:6606:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788178992.317046:0:6606:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc901498000/0xaa4c98508c49881f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498826 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.317051:0:6606:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788178992.317056:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc901498000/0xaa4c98508c49881f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498826 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.317061:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc901498000/0xaa4c98508c49881f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498826 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.317077:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788178992.317079:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788178992.317081:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788178992.317089:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788178992.317094:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788178992.317099:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788178992.317118:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471969024:0@lo:103: 00000100:00100000:0.0:1788178992.317148:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178992.317176:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471969536:0@lo:103: 00000100:00100000:0.0:1788178992.317194:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178992.317212:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788178992.317217:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471969408:0@lo:103: 00000100:00100000:0.0:1788178992.317250:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178992.317290:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041471969152:0@lo:103: 00000100:00100000:0.0:1788178992.317312:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178992.317323:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788178992.317327:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041471969280:0@lo:103: 00000100:00100000:0.0:1788178992.317342:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178992.317366:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471969024 00000100:00100000:0.0:1788178992.317371:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471969024 00010000:00010000:0.0:1788178992.317388:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c4988c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c4988b9 expref: 17 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788178992.317402:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471969536 00000100:00100000:0.0:1788178992.317405:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471969536 00010000:00010000:0.0:1788178992.317415:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc942172400/0xaa4c98508c498826 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c49881f expref: 18 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788178992.317424:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471969408 00000100:00100000:0.0:1788178992.317427:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471969408 00010000:00010000:0.0:1788178992.317435:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc901498400/0xaa4c98508c498850 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c498849 expref: 19 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788178992.317444:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471969152 00000100:00100000:0.0:1788178992.317446:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471969152 00010000:00010000:0.0:1788178992.317454:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc942173000/0xaa4c98508c498896 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c49888f expref: 20 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788178992.317463:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471969280 00000100:00100000:0.0:1788178992.317465:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471969280 00010000:00010000:0.0:1788178992.317474:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc901499600/0xaa4c98508c49887a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c498873 expref: 21 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788178992.317499:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788178992.317505:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efc6f743-3303-46d5-8807-513b82cac1cc+21:3308:x1875041471969024:12345-0@lo:103: 00010000:00010000:0.0:1788178992.317516:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788178992.317521:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c4988c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c4988b9 expref: 21 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.317530:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c4988c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c4988b9 expref: 21 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.317545:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788178992.317572:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efc6f743-3303-46d5-8807-513b82cac1cc+21:3308:x1875041471969024:12345-0@lo:103: Request processed in 68us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178992.317578:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788178992.317592:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788178992.317598:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efc6f743-3303-46d5-8807-513b82cac1cc+20:3308:x1875041471969536:12345-0@lo:103: 00010000:00010000:0.0:1788178992.317605:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788178992.317609:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc942172400/0xaa4c98508c498826 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c49881f expref: 20 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.317616:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc942172400/0xaa4c98508c498826 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c49881f expref: 20 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.317625:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788178992.317646:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efc6f743-3303-46d5-8807-513b82cac1cc+20:3308:x1875041471969536:12345-0@lo:103: Request processed in 48us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178992.317652:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788178992.317663:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788178992.317675:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efc6f743-3303-46d5-8807-513b82cac1cc+19:3308:x1875041471969408:12345-0@lo:103: 00010000:00010000:0.0:1788178992.317683:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788178992.317687:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc901498400/0xaa4c98508c498850 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c498849 expref: 19 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.317695:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc901498400/0xaa4c98508c498850 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c498849 expref: 19 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.317704:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788178992.317725:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efc6f743-3303-46d5-8807-513b82cac1cc+19:3308:x1875041471969408:12345-0@lo:103: Request processed in 50us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178992.317731:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788178992.317744:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788178992.317751:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efc6f743-3303-46d5-8807-513b82cac1cc+18:3305:x1875041471969152:12345-0@lo:103: 00010000:00010000:0.0:1788178992.317757:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788178992.317762:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc942173000/0xaa4c98508c498896 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c49888f expref: 18 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.317770:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc942173000/0xaa4c98508c498896 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c49888f expref: 18 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.317779:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788178992.317803:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efc6f743-3303-46d5-8807-513b82cac1cc+18:3305:x1875041471969152:12345-0@lo:103: Request processed in 53us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178992.317809:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788178992.317820:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788178992.317825:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efc6f743-3303-46d5-8807-513b82cac1cc+17:3305:x1875041471969280:12345-0@lo:103: 00010000:00010000:0.0:1788178992.317832:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788178992.317842:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc901499600/0xaa4c98508c49887a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c498873 expref: 17 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.317875:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc901499600/0xaa4c98508c49887a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c498873 expref: 17 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.317901:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bc9136c5a00/0xaa4c98508c4988d5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.317911:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9136c5a00/0xaa4c98508c4988d5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.317924:0:5783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bc9136c5a00/0xaa4c98508c4988d5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.317932:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bc9136c5a00/0xaa4c98508c4988d5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.317939:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bc9136c5a00/0xaa4c98508c4988d5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.317945:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bc9136c5a00/0xaa4c98508c4988d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.317950:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5a00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788178992.317954:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bc9136c5a00/0xaa4c98508c4988d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.317961:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bc9136c5a00/0xaa4c98508c4988d5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.317968:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bc9136c5a00/0xaa4c98508c4988d5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.317987:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788178992.318008:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efc6f743-3303-46d5-8807-513b82cac1cc+17:3305:x1875041471969280:12345-0@lo:103: Request processed in 183us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178992.318015:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788178992.318058:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041471969280:0@lo:103: 00000100:00100000:0.0:1788178992.318068:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041471969152:0@lo:103: 00000100:00100000:0.0:1788178992.318096:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471969408:0@lo:103: 00000100:00100000:0.0:1788178992.318104:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471969024:0@lo:103: 00000100:00100000:0.0:1788178992.318111:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471969536:0@lo:103: 00010000:00010000:1.0:1788178992.318343:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c4988c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c4988b9 expref: 16 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178992.318355:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5790:1875041471968384:0@lo:104: 00010000:00010000:1.0:1788178992.318365:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc942173000/0xaa4c98508c498896 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c49888f expref: 15 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178992.318374:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5790:1875041471968512:0@lo:104: 00010000:00010000:1.0:1788178992.318382:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc901499600/0xaa4c98508c49887a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c498873 expref: 14 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178992.318390:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5790:1875041471968640:0@lo:104: 00010000:00010000:1.0:1788178992.318397:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc901498400/0xaa4c98508c498850 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c498849 expref: 13 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178992.318407:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5790:1875041471968768:0@lo:104: 00010000:00010000:1.0:1788178992.318416:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc942172400/0xaa4c98508c498826 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c49881f expref: 12 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178992.318425:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5790:1875041471968896:0@lo:104: 00010000:00010000:1.0:1788178992.318448:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bc9136c5a00/0xaa4c98508c4988d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178992.318456:0:5790:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bc9136c5a00/0xaa4c98508c4988d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178992.318462:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bc9136c5a00/0xaa4c98508c4988d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178992.318479:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc9136c5a00/0xaa4c98508c4988d5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788178992.318499:0:5790:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:0.0:1788178992.394101:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788178992.428119:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+11:7479:x1875041471968256:12345-0@lo:253: Request processed in 125683us (136756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178992.428134:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788178992.429518:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bf8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471968256:0@lo:253: 10000000:01000000:0.0:1788178992.429535:0:7479:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788178992.429539:0:7479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788178992.429541:0:7479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788178992.429542:0:7479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788178992.429543:0:7479:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788178992.429545:0:7479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788178992.429546:0:7479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788178992.429547:0:7479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788178992.429549:0:7479:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788178992.429550:0:7479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788178992.429552:0:7479:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788178992.429585:0:7479:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bc902f11000 from lustre-OST0001 10000000:01000000:0.0:1788178992.429607:0:7479:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788178992.429622:0:7479:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788178992.429630:0:7479:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bc9265819c0 local copy 10000000:01000000:0.0:1788178992.429634:0:7479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788178992.429669:0:7479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c4988dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.429679:0:7479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c4988dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.429688:0:7479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c4988dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788178992.429704:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471969664:0@lo:101: 00000100:00100000:2.0:1788178992.445720:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788178992.446134:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9354263c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788178992.446223:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471969664 00000100:00100000:3.0:1788178992.446233:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471969664 00000100:00100000:3.0:1788178992.446300:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788178992.446310:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+11:7479:x1875041471969664:12345-0@lo:101: 00010000:00010000:3.0:1788178992.446326:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788178992.446345:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9137b4e00/0xaa4c98508c4988e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c4988dc expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178992.446371:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9137b4e00/0xaa4c98508c4988e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c4988dc expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178992.446382:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9137b4e00/0xaa4c98508c4988e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c4988dc expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178992.446391:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4e00, rc 0) 00000100:00100000:3.0:1788178992.446437:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+12:7479:x1875041471969664:12345-0@lo:101: Request processed in 129us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178992.446444:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788178992.446679:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471969664:0@lo:101: 00010000:00010000:2.0:1788178992.446696:0:7479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c4988dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xaa4c98508c4988e3 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178992.446705:0:7479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c4988dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xaa4c98508c4988e3 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788178992.446882:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471969792:0@lo:501: 00000100:00100000:2.0:1788178992.446913:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788178992.446943:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc926545cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788178992.447555:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471969792 00000100:00100000:3.0:1788178992.447562:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471969792 00000100:00100000:3.0:1788178992.447593:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788178992.447601:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+12:7479:x1875041471969792:12345-0@lo:501: 00000100:00100000:3.0:1788178992.447839:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+12:7479:x1875041471969792:12345-0@lo:501: Request processed in 238us (924us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788178992.447966:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471969792:0@lo:501: 10000000:01000000:2.0:1788178992.447982:0:7479:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788178992.448010:0:7479:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788178992.448017:0:7479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c4988dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xaa4c98508c4988e3 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178992.448025:0:7479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c4988dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xaa4c98508c4988e3 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178992.448033:0:7479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c4988dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xaa4c98508c4988e3 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178992.448061:0:7479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788178992.448083:0:7479:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bc902f11000 10000000:01000000:2.0:1788178992.448087:0:7479:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788178992.448093:0:7479:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788178992.448095:0:7479:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788178992.448099:0:7479:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788178992.448102:0:7479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788178992.448123:0:7479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5600/0xaa4c98508c4988ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178992.448131:0:7479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5600/0xaa4c98508c4988ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178992.448151:0:7479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5600/0xaa4c98508c4988ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788178992.448165:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471969920:0@lo:101: 00000100:00100000:2.0:1788178992.448207:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788178992.448227:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc926545b40 going to sleep for 11 seconds 00010000:00010000:1.0:1788178992.448292:0:6605:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788178992.448299:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c4988dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xaa4c98508c4988e3 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178992.448306:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc900030e00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:1.0:1788178992.448310:0:6605:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c4988dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xaa4c98508c4988e3 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178992.448317:0:6605:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c4988dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xaa4c98508c4988e3 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788178992.448323:0:6605:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c4988dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xaa4c98508c4988e3 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788178992.448328:0:6605:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788178992.448346:0:6605:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c4988dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xaa4c98508c4988e3 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178992.448352:0:6605:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788178992.448376:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c4988dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xaa4c98508c4988e3 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178992.448383:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c4988dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xaa4c98508c4988e3 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178992.448395:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788178992.448402:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788178992.448403:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788178992.448415:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471969920 00000100:00100000:1.0:1788178992.448419:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471969920 00000100:00100000:2.0:1788178992.448468:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041471970048:0@lo:103: 00000100:00100000:2.0:1788178992.448495:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178992.448731:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788178992.449010:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471970048 00000100:00100000:0.0:1788178992.449016:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471970048 00000100:00100000:0.0:1788178992.449047:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788178992.449054:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efc6f743-3303-46d5-8807-513b82cac1cc+13:3305:x1875041471970048:12345-0@lo:103: 00010000:00010000:0.0:1788178992.449066:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788178992.449077:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc9137b4e00/0xaa4c98508c4988e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa4c98508c4988dc expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.449092:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788178992.449133:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efc6f743-3303-46d5-8807-513b82cac1cc+12:3305:x1875041471970048:12345-0@lo:103: Request processed in 79us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178992.449139:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788178992.449307:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041471970048:0@lo:103: 00000100:00100000:1.0:1788178992.449475:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788178992.449484:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+11:7479:x1875041471969920:12345-0@lo:101: 00010000:00010000:1.0:1788178992.449494:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788178992.449507:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c4988f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c4988ea expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178992.449525:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c4988f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c4988ea expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178992.449535:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c4988f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c4988ea expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178992.449542:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317fc00, rc 0) 00000100:00100000:1.0:1788178992.449586:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+12:7479:x1875041471969920:12345-0@lo:101: Request processed in 102us (1377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178992.449591:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788178992.449653:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471969920:0@lo:101: 00010000:00010000:0.0:1788178992.449666:0:7479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5600/0xaa4c98508c4988ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c4988f1 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.449675:0:7479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5600/0xaa4c98508c4988ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c4988f1 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788178992.449780:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471970176:0@lo:501: 00000100:00100000:0.0:1788178992.449808:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178992.449838:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc935426c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788178992.449958:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471970176 00000100:00100000:1.0:1788178992.449963:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471970176 00000100:00100000:1.0:1788178992.449994:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788178992.450000:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+12:7479:x1875041471970176:12345-0@lo:501: 00000100:00100000:1.0:1788178992.450215:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+12:7479:x1875041471970176:12345-0@lo:501: Request processed in 215us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178992.450222:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788178992.452052:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471970176:0@lo:501: 00000100:00100000:0.0:1788178992.452103:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471970304:0@lo:503: 00000100:00100000:0.0:1788178992.452166:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178992.452214:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc935426c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788178992.452407:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471970304 00000100:00100000:1.0:1788178992.452413:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471970304 00000100:00100000:1.0:1788178992.452466:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788178992.452474:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+12:7479:x1875041471970304:12345-0@lo:503: 00000100:00100000:1.0:1788178992.452655:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+12:7479:x1875041471970304:12345-0@lo:503: Request processed in 181us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178992.452662:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788178992.452905:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471970304:0@lo:503: 00000040:00080000:0.0:1788178992.453214:0:7479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788178992.453388:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471970432:0@lo:502: 00000100:00100000:0.0:1788178992.453429:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178992.453455:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc935426c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788178992.453517:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471970432 00000100:00100000:1.0:1788178992.453522:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471970432 00000100:00100000:1.0:1788178992.453548:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788178992.453555:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+12:7479:x1875041471970432:12345-0@lo:502: 00000100:00100000:1.0:1788178992.453687:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+12:7479:x1875041471970432:12345-0@lo:502: Request processed in 131us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178992.453694:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788178992.453910:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471970432:0@lo:502: 00000040:00080000:0.0:1788178992.454123:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788178992.454171:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788178992.454219:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788178992.454490:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788178992.454547:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788178992.454584:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788178992.454611:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471970560:0@lo:502: 00000100:00100000:3.0:1788178992.454655:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178992.454689:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93fadc000 going to sleep for 11 seconds 00000100:00100000:0.0:1788178992.455010:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471970560 00000100:00100000:0.0:1788178992.455017:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471970560 00000100:00100000:0.0:1788178992.455055:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788178992.455063:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+12:7479:x1875041471970560:12345-0@lo:502: 00000100:00100000:0.0:1788178992.455387:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+12:7479:x1875041471970560:12345-0@lo:502: Request processed in 324us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178992.455394:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788178992.455536:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471970560:0@lo:502: 00000040:00080000:3.0:1788178992.455631:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788178992.455641:0:7479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1788178992.456704:0:7487:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788178992.456718:0:7487:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788178992.456816:0:7487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788178992.456819:0:7487:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788178992.456827:0:7487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788178992.456841:0:7487:0:(genops.c:414:class_newdev()) Allocate new device lustre-OST0001 (ffff9bc926584d40) 00000020:00000080:0.0:1788178992.457008:0:7487:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788178992.457018:0:7487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788178992.457094:0:7487:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bc902f11000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788178992.457102:0:7487:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788178992.457109:0:7487:0:(genops.c:1407:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xaa4c98508c4988ff 00010000:00010000:1.0:1788178992.475644:0:7487:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1788178992.476160:0:7487:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788178992.480229:0:7487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788178992.482542:0:7487:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788178992.491960:0:7487:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788178992.492667:0:7487:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788178992.496193:0:7487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788178992.496206:0:7487:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788178992.496212:0:7487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788178992.496214:0:7487:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788178992.496217:0:7487:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788178992.496220:0:7487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788178992.496222:0:7487:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788178992.496224:0:7487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788178992.496226:0:7487:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788178992.496405:0:7487:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788178992.496410:0:7487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788178992.496411:0:7487:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788178992.496415:0:7487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788178992.497387:0:7479:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788178992.497414:0:7479:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788178992.497435:0:7479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5600/0xaa4c98508c4988ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c4988f1 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178992.497448:0:7479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5600/0xaa4c98508c4988ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c4988f1 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788178992.497457:0:7479:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bc902f11000 from 1 10000000:01000000:2.0:1788178992.497460:0:7479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788178992.497493:0:7479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4600/0xaa4c98508c498906 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178992.497502:0:7479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4600/0xaa4c98508c498906 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178992.497511:0:7479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4600/0xaa4c98508c498906 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788178992.497556:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471970688:0@lo:101: 00000100:00100000:2.0:1788178992.497619:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788178992.497657:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc926545cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788178992.498350:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471970688 00000100:00100000:2.0:1788178992.498358:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471970688 00000100:00100000:2.0:1788178992.498400:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788178992.498409:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+12:7479:x1875041471970688:12345-0@lo:101: 00010000:00010000:2.0:1788178992.498423:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788178992.498437:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9136c5200/0xaa4c98508c49890d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c498906 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178992.498459:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9136c5200/0xaa4c98508c49890d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c498906 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178992.498470:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9136c5200/0xaa4c98508c49890d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498906 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178992.498479:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c5200, rc 0) 00000100:00100000:2.0:1788178992.498520:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+13:7479:x1875041471970688:12345-0@lo:101: Request processed in 112us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788178992.498527:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788178992.498575:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471970688:0@lo:101: 00010000:00010000:2.0:1788178992.498590:0:7479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4600/0xaa4c98508c498906 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c49890d expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788178992.498599:0:7479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4600/0xaa4c98508c498906 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c49890d expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788178992.498698:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471970816:0@lo:501: 00000100:00100000:2.0:1788178992.499246:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788178992.499318:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc926545cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788178992.507520:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471970816 00000100:00100000:1.0:1788178992.507543:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471970816 00000100:00100000:3.0:1788178992.514375:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788178992.514391:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+13:7479:x1875041471970816:12345-0@lo:501: 00000100:00100000:3.0:1788178992.514710:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+13:7479:x1875041471970816:12345-0@lo:501: Request processed in 321us (15984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178992.514719:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788178992.514819:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471970816:0@lo:501: 00000100:00100000:0.0:1788178992.514903:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471970944:0@lo:503: 00000100:00100000:0.0:1788178992.514949:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178992.517679:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9354263c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788178992.526832:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471970944 00000100:00100000:2.0:1788178992.526900:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471970944 00000100:00100000:2.0:1788178992.526970:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788178992.526982:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+13:7479:x1875041471970944:12345-0@lo:503: 00000100:00100000:2.0:1788178992.527756:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+13:7479:x1875041471970944:12345-0@lo:503: Request processed in 775us (12805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788178992.527765:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788178992.530957:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471970944:0@lo:503: 00000040:00080000:0.0:1788178992.531534:0:7479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788178992.531615:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471971072:0@lo:502: 00000100:00100000:0.0:1788178992.531691:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178992.531800:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9354263c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788178992.532235:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471971072 00000100:00100000:3.0:1788178992.532242:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471971072 00000100:00100000:3.0:1788178992.532578:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788178992.532588:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+13:7479:x1875041471971072:12345-0@lo:502: 00000100:00100000:3.0:1788178992.532837:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+13:7479:x1875041471971072:12345-0@lo:502: Request processed in 249us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178992.532844:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788178992.533091:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471971072:0@lo:502: 00000040:00080000:0.0:1788178992.533554:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788178992.533609:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788178992.533643:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471971200:0@lo:502: 00000100:00100000:0.0:1788178992.533690:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178992.533736:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9354263c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788178992.534322:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471971200 00000100:00100000:3.0:1788178992.534328:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471971200 00000100:00100000:3.0:1788178992.534367:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788178992.534376:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+13:7479:x1875041471971200:12345-0@lo:502: 00000100:00100000:3.0:1788178992.534533:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+13:7479:x1875041471971200:12345-0@lo:502: Request processed in 158us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178992.534541:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788178992.534987:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471971200:0@lo:502: 00000040:00080000:0.0:1788178992.535095:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788178992.535112:0:7479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788178992.536002:0:7491:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788178992.536013:0:7491:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788178992.536015:0:7491:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788178992.536022:0:7491:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bc902f11000 00000020:00000080:3.0:1788178992.536024:0:7491:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788178992.536044:0:7491:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788178992.536047:0:7491:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788178992.536049:0:7491:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788178992.536051:0:7491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788178992.536338:0:7479:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788178992.536362:0:7479:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788178992.536419:0:7479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4600/0xaa4c98508c498906 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c49890d expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.536430:0:7479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4600/0xaa4c98508c498906 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c49890d expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788178992.536472:0:7479:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788178992.536476:0:7479:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bc902f11000 10000000:01000000:0.0:1788178992.536478:0:7479:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bc902f11000 10000000:01000000:0.0:1788178992.536482:0:7479:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788178992.536488:0:7479:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9bc902f11000 from 1 10000000:01000000:0.0:1788178992.536491:0:7479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788178992.536522:0:7479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.536530:0:7479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.536540:0:7479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788178992.536561:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471971328:0@lo:101: 00000100:00100000:0.0:1788178992.536616:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178992.536655:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9354263c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788178992.543756:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471971328 00000100:00100000:3.0:1788178992.543771:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471971328 00000100:00100000:3.0:1788178992.543833:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788178992.543842:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+13:7479:x1875041471971328:12345-0@lo:101: 00010000:00010000:3.0:1788178992.543877:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788178992.543898:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9137b4c00/0xaa4c98508c49891b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c498914 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178992.543925:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9137b4c00/0xaa4c98508c49891b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c498914 expref: 14 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178992.543936:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9137b4c00/0xaa4c98508c49891b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498914 expref: 14 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178992.543945:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4c00, rc 0) 00000100:00100000:3.0:1788178992.544016:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+14:7479:x1875041471971328:12345-0@lo:101: Request processed in 175us (7398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178992.544023:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788178992.544192:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471971328:0@lo:101: 00010000:00010000:0.0:1788178992.544211:0:7479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498914 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c49891b expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.544237:0:7479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498914 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c49891b expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788178992.544527:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471971456:0@lo:501: 00000100:00100000:0.0:1788178992.544576:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178992.544616:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9354263c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788178992.544755:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471971456 00000100:00100000:2.0:1788178992.544761:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471971456 00000100:00100000:2.0:1788178992.544799:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788178992.544806:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+14:7479:x1875041471971456:12345-0@lo:501: 00000100:00100000:2.0:1788178992.545058:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+14:7479:x1875041471971456:12345-0@lo:501: Request processed in 252us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788178992.545064:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788178992.547041:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471971456:0@lo:501: 00000100:00100000:0.0:1788178992.547094:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471971584:0@lo:503: 00000100:00100000:0.0:1788178992.547172:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788178992.547358:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471971584 00000100:00100000:2.0:1788178992.547365:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471971584 00000100:00100000:2.0:1788178992.547414:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788178992.547422:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+14:7479:x1875041471971584:12345-0@lo:503: 00000100:00100000:2.0:1788178992.547594:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+14:7479:x1875041471971584:12345-0@lo:503: Request processed in 172us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788178992.547602:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788178992.547678:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9354263c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788178992.547692:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471971584:0@lo:503: 00000040:00080000:0.0:1788178992.547993:0:7479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788178992.548052:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471971712:0@lo:502: 00000100:00100000:0.0:1788178992.548087:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178992.548113:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9354263c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788178992.550152:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471971712 00000100:00100000:2.0:1788178992.550189:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471971712 00000100:00100000:2.0:1788178992.550245:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788178992.550255:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+14:7479:x1875041471971712:12345-0@lo:502: 00000100:00100000:2.0:1788178992.550652:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+14:7479:x1875041471971712:12345-0@lo:502: Request processed in 398us (2562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788178992.550659:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788178992.550836:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471971712:0@lo:502: 00000040:00080000:0.0:1788178992.551167:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788178992.552969:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788178992.553007:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788178992.553056:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788178992.553090:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788178992.553841:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788178992.554977:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788178992.555018:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788178992.555079:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788178992.555115:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788178992.555166:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788178992.555212:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788178992.555244:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788178992.555291:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788178992.555341:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788178992.555377:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788178992.555415:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788178992.555465:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788178992.555502:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788178992.555536:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788178992.555586:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788178992.555638:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788178992.555676:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788178992.555723:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788178992.555758:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788178992.555790:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788178992.555834:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788178992.555897:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1788178992.555931:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788178992.555976:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1788178992.556009:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1788178992.556042:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1788178992.556077:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1788178992.556126:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1788178992.556163:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1788178992.556232:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1788178992.559553:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1788178992.559627:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471971840:0@lo:502: 00000100:00100000:0.0:1788178992.559713:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178992.559762:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9354263c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788178992.559836:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471971840 00000100:00100000:2.0:1788178992.559843:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471971840 00000100:00100000:2.0:1788178992.559929:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788178992.559940:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+14:7479:x1875041471971840:12345-0@lo:502: 00000100:00100000:2.0:1788178992.560185:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+14:7479:x1875041471971840:12345-0@lo:502: Request processed in 237us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788178992.560193:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788178992.560693:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471971840:0@lo:502: 00000040:00080000:0.0:1788178992.560827:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1788178992.560839:0:7479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788178992.564448:0:7492:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788178992.564482:0:7492:0:(genops.c:414:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9bc93b678000) 00000020:00000080:2.0:1788178992.564505:0:7492:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1788178992.564681:0:7492:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bc902f11000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788178992.564685:0:7492:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bc902f11000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788178992.564688:0:7492:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bc902f11000 3 00010000:00080000:2.0:1788178992.564741:0:7492:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bc93b620800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.102@tcp at head 00010000:00010000:2.0:1788178992.566285:0:7492:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1788178992.566366:0:7492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788178992.566397:0:7492:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788178992.566408:0:7492:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xaa4c98508c498929 00000100:00080000:2.0:1788178992.566418:0:7492:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788178992.566422:0:7492:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bc93b620800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:2.0:1788178992.566455:0:7492:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bc910b9fb80 x1875041471971968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788178992.566489:0:7492:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788178992.566578:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788178992.566594:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041471972096:0@lo:400: 00000100:00100000:2.0:1788178992.566659:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178992.567278:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875041471971968:0@lo:38: 00000100:00100000:0.0:1788178992.567316:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178992.567358:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875041471972224:0@lo:400: 00000100:00100000:0.0:1788178992.567381:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178992.567399:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788178992.567405:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471972352:0@lo:400: 00000100:00100000:0.0:1788178992.567429:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178992.567461:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471972096 00000100:00100000:0.0:1788178992.567468:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471972096 00000100:00100000:0.0:1788178992.567506:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471971968 00000100:00100000:0.0:1788178992.567509:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471971968 00000100:00100000:0.0:1788178992.567517:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471972224 00000100:00100000:0.0:1788178992.567520:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471972224 00000100:00100000:0.0:1788178992.567540:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788178992.567548:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041471972096:12345-0@lo:400: 00000100:00100000:0.0:1788178992.567597:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041471972096:12345-0@lo:400: Request processed in 49us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178992.567604:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788178992.567621:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788178992.567629:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875041471972224:12345-0@lo:400: 00000100:00100000:0.0:1788178992.567658:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875041471972224:12345-0@lo:400: Request processed in 30us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178992.567663:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788178992.567673:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788178992.567678:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1875041471971968:12345-0@lo:38: 00010000:00080000:0.0:1788178992.567705:0:5797:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:0.0:1788178992.567752:0:5797:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xaa4c98508c498930 00000004:00100000:0.0:1788178992.567766:0:5797:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788178992.567795:0:5797:0:(import.c:65:import_set_state_nolock()) ffff9bc934be6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788178992.567835:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875041471971968:12345-0@lo:38: Request processed in 155us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178992.567841:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788178992.567880:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471972352 00000100:00100000:0.0:1788178992.567884:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471972352 00000100:00100000:0.0:1788178992.567909:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788178992.567915:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471972352:12345-0@lo:400: 00000100:00100000:0.0:1788178992.567943:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471972352:12345-0@lo:400: Request processed in 29us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178992.567948:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788178992.567966:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788178992.567969:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788178992.567991:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc910b9c380 x1875041471972352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788178992.568002:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471972352:0@lo:400: 00010000:00080000:0.0:1788178992.568012:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc910b9df80 x1875041471972224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788178992.568018:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875041471972224:0@lo:400: 00010000:00080000:0.0:1788178992.568043:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc910b9fb80 x1875041471971968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788179002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788178992.568050:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788178992.568056:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788178992.568069:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788178992.568073:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788178992.568076:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9bc93b620800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788178992.568082:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875041471971968:0@lo:38: 00010000:00080000:0.0:1788178992.568113:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc910b9f800 x1875041471972096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788178992.568132:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041471972096:0@lo:400: 00000040:00080000:0.0:1788178992.569792:0:7492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1788178992.569840:0:7479:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788178992.569882:0:7479:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788178992.569901:0:7479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498914 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c49891b expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.569912:0:7479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c49891b expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788178992.569955:0:7479:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788178992.569957:0:7479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788178992.569959:0:7479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788178992.569960:0:7479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788178992.569962:0:7479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788178992.569963:0:7479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788178992.569964:0:7479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788178992.569966:0:7479:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788178992.569967:0:7479:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788178992.569969:0:7479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788178992.569970:0:7479:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788178992.569974:0:7479:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788178992.569976:0:7479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788178992.569977:0:7479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788178992.569978:0:7479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788178992.569984:0:7479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788178992.569985:0:7479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788178992.569986:0:7479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788178992.569987:0:7479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788178992.569988:0:7479:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788178992.569988:0:7479:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788178992.569989:0:7479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788178992.569990:0:7479:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788178992.570011:0:7479:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788178992.570024:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471972480:0@lo:253: 00000100:00100000:0.0:1788178992.570077:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178992.570098:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc935426600 going to sleep for 11 seconds 00000100:00100000:0.0:1788178992.570123:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471972480 00000100:00100000:0.0:1788178992.570129:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471972480 00000100:00100000:0.0:1788178992.570164:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788178992.570172:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+14:7479:x1875041471972480:12345-0@lo:253: 20000000:01000000:0.0:1788178992.570193:0:5790:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788178992.570207:0:5790:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788178992.575102:0:7493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bf9f80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7493:1875041471972608:0@lo:901: 00000100:00100000:1.0:1788178992.575393:0:7493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178992.575431:0:7493:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc926544b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788178992.576623:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471972608 00000100:00100000:1.0:1788178992.576635:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471972608 00000100:00100000:1.0:1788178992.576708:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788178992.577001:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7493:x1875041471972608:12345-0@lo:901: 00000100:00100000:1.0:1788178992.579421:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7493:x1875041471972608:12345-0@lo:901: Request processed in 2419us (4022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178992.579434:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788178992.579496:0:7493:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc934bf9f80 x1875041471972608/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788179008 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788178992.579511:0:7493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bf9f80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7493:1875041471972608:0@lo:901: 00000100:00080000:0.0:1788178992.582009:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:3.0:1788178992.646713:0:5790:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788178992.646735:0:5790:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788178992.646884:0:5812:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788178992.646890:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788178992.646915:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bc91317f400/0xaa4c98508c498937 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178992.646935:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc942172e00/0xaa4c98508c498888 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498881 expref: 14 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178992.646944:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bc91317f400/0xaa4c98508c498937 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178992.646985:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc942172e00/0xaa4c98508c498888 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c498881 expref: 14 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178992.646999:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bc942172e00/0xaa4c98508c498888 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c498881 expref: 14 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178992.647032:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bf9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1875041471972736:0@lo:104: 00000100:00100000:1.0:1788178992.647095:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178992.647224:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471972736 00000100:00100000:3.0:1788178992.647232:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471972736 00000100:00100000:3.0:1788178992.647298:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788178992.647308:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+3:5812:x1875041471972736:12345-0@lo:104: 00010000:00010000:3.0:1788178992.647320:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c498881 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498888 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178992.647370:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788178992.647376:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+3:5812:x1875041471972736:12345-0@lo:104: Request processed in 71us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178992.647383:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788178992.647580:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc935394f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788178992.647602:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bf9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5812:1875041471972736:0@lo:104: 00010000:00010000:1.0:1788178992.647619:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bc91317f400/0xaa4c98508c498937 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.647770:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788178992.647777:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c498881 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498888 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.647785:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc942173e00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1788178992.647789:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c498881 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c498888 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.647799:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c498881 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c498888 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788178992.647806:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c498881 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c498888 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788178992.647822:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788178992.647894:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c498881 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498888 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.647901:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788178992.647918:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c498881 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498888 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.647924:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c498881 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498888 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.647948:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788178992.647950:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788178992.647951:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788178992.647959:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788178992.647969:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041471972864:0@lo:103: 00000100:00100000:0.0:1788178992.648002:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178992.648033:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471972864 00000100:00100000:0.0:1788178992.648037:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471972864 00010000:00010000:0.0:1788178992.648057:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc942172e00/0xaa4c98508c498888 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c498881 expref: 15 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788178992.648078:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788178992.648085:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc905f65050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+15:3306:x1875041471972864:12345-0@lo:103: 00010000:00010000:0.0:1788178992.648096:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788178992.648100:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc942172e00/0xaa4c98508c498888 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c498881 expref: 15 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.648110:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc942172e00/0xaa4c98508c498888 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c498881 expref: 15 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.650307:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc942172e00/0xaa4c98508c498888 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c498881 expref: 15 pid: 5789 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.650326:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bc91317f400/0xaa4c98508c498937 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.650335:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc91317f400/0xaa4c98508c498937 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788178992.650352:0:5781:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003462856s 00010000:00010000:0.0:1788178992.650357:0:5781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bc91317f400/0xaa4c98508c498937 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.650364:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bc91317f400/0xaa4c98508c498937 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.650372:0:5781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bc91317f400/0xaa4c98508c498937 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.650379:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bc91317f400/0xaa4c98508c498937 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.650386:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f400 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788178992.650390:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bc91317f400/0xaa4c98508c498937 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.650398:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bc91317f400/0xaa4c98508c498937 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.650413:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bc91317f400/0xaa4c98508c498937 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.650440:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788178992.650500:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc905f65050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+14:3306:x1875041471972864:12345-0@lo:103: Request processed in 2415us (2496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178992.650509:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788178992.650593:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041471972864:0@lo:103: 00010000:00010000:0.0:1788178992.650617:0:5812:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bc91317f400/0xaa4c98508c498937 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.650624:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bc91317f400/0xaa4c98508c498937 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178992.650629:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc91317f400/0xaa4c98508c498937 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788178992.701838:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+13:7479:x1875041471972480:12345-0@lo:253: Request processed in 131657us (131750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178992.701885:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788178992.709345:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:efc6f743-3303-46d5-8807-513b82cac1cc:7479:1875041471972480:0@lo:253: 10000000:01000000:1.0:1788178992.709367:0:7479:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788178992.709371:0:7479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788178992.709373:0:7479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788178992.709374:0:7479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788178992.709375:0:7479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788178992.709376:0:7479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788178992.709377:0:7479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788178992.709379:0:7479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788178992.709380:0:7479:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788178992.709382:0:7479:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788178992.709383:0:7479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788178992.709385:0:7479:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788178992.709415:0:7479:0:(tgt_mount.c:2766:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788178992.724840:0:7479:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788178992.725056:0:7479:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788178992.732565:0:7479:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788178992.732918:0:7479:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788178992.733161:0:7479:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788178992.736890:0:7479:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788178992.745735:0:7479:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1788178992.838756:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041471972992:0@lo:13: 00000100:00100000:3.0:1788178992.838828:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178992.839085:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471972992 00000100:00100000:3.0:1788178992.839093:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471972992 00000100:00100000:3.0:1788178992.839139:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788178992.839149:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041471972992:12345-0@lo:13: 00002000:00000024:3.0:1788178992.839183:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788178992.839227:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041471972992:12345-0@lo:13: Request processed in 79us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178992.839234:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788178992.839349:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc93539ce00 x1875041471972992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788178992.839368:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041471972992:0@lo:13: 00002000:00080000:1.0:1788178993.114420:0:7479:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788178993.114441:0:7479:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788178993.114476:0:7479:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788178993.114537:0:7479:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.102@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788178993.114551:0:7479:0:(tgt_mount.c:2535:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788178993.114572:0:7479:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788178993.410427:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788178994.434972:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788178995.457009:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788178996.480333:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788178997.506032:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788178997.952023:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788178997.952048:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041471973120:0@lo:13: 00000100:00100000:3.0:1788178997.952117:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178997.952192:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471973120 00000100:00100000:3.0:1788178997.952213:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471973120 00000100:00100000:3.0:1788178997.952288:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788178997.952297:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041471973120:12345-0@lo:13: 00002000:00000024:3.0:1788178997.952332:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788178997.952376:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041471973120:12345-0@lo:13: Request processed in 80us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178997.952382:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788178997.952432:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93539ce00 x1875041471973120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788178997.952450:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041471973120:0@lo:13: 00000100:00080000:0.0:1788178997.952602:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788178997.955709:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471973248:0@lo:400: 00000100:00100000:0.0:1788178997.955777:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178997.955944:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471973248 00000100:00100000:1.0:1788178997.955951:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471973248 00000100:00100000:1.0:1788178997.955997:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788178997.956005:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+13:3308:x1875041471973248:12345-0@lo:400: 00000100:00100000:3.0:1788178997.957887:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041471973376:0@lo:400: 00000100:00100000:0.0:1788178997.962915:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471973248:0@lo:400: 00000100:00100000:0.0:1788178997.970269:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788178997.970290:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041471973632:0@lo:400: 00000100:00100000:1.0:1788178997.970410:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+13:3308:x1875041471973248:12345-0@lo:400: Request processed in 14402us (14630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178997.970421:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788178997.975172:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178997.975242:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788178997.975254:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041471973504:0@lo:400: 00000100:00100000:3.0:1788178997.975303:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178997.980199:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471973376 00000100:00100000:1.0:1788178997.980226:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471973376 00000100:00100000:1.0:1788178997.980293:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471973504 00000100:00100000:1.0:1788178997.980296:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471973504 00000100:00100000:1.0:1788178997.980330:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788178997.980339:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041471973376:12345-0@lo:400: 00000100:00100000:1.0:1788178997.980437:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041471973376:12345-0@lo:400: Request processed in 99us (5272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178997.980444:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788178997.980466:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788178997.980473:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041471973504:12345-0@lo:400: 00000100:00100000:1.0:1788178997.980504:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041471973504:12345-0@lo:400: Request processed in 31us (5200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178997.980510:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788178997.980535:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788178997.980571:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93539e300 x1875041471973504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788178997.980598:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041471973504:0@lo:400: 00010000:00080000:1.0:1788178997.980614:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93539d180 x1875041471973376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788178997.980623:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041471973376:0@lo:400: 00000100:00100000:0.0:1788178997.989513:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178997.994073:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471973632 00000100:00100000:1.0:1788178997.994088:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471973632 00000100:00100000:1.0:1788178997.994172:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788178997.994184:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041471973632:12345-0@lo:400: 00000100:00100000:1.0:1788178997.994288:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041471973632:12345-0@lo:400: Request processed in 106us (4784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178997.994295:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788178997.995036:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788178997.995078:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93539ea00 x1875041471973632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788178997.995094:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041471973632:0@lo:400: 00010000:00010000:3.0:1788178998.528264:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788178998.984297:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788178998.984307:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9bc913608800 from 30 10000000:01000000:1.0:1788178998.984313:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788178998.984424:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c49893e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178998.984438:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c49893e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178998.984449:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c49893e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178998.984475:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471973760:0@lo:101: 00000100:00100000:1.0:1788178998.984612:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178998.984663:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9357d7480 going to sleep for 11 seconds 00000100:00100000:1.0:1788178998.984763:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471973760 00000100:00100000:1.0:1788178998.984877:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471973760 00000100:00100000:1.0:1788178998.984926:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788178998.984935:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+13:5793:x1875041471973760:12345-0@lo:101: 00010000:00010000:1.0:1788178998.984950:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788178998.984963:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc91317f400/0xaa4c98508c498945 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c49893e expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178998.984987:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc91317f400/0xaa4c98508c498945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c49893e expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178998.984999:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc91317f400/0xaa4c98508c498945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c49893e expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178998.985008:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317f400, rc 0) 00000100:00100000:1.0:1788178998.985047:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+14:5793:x1875041471973760:12345-0@lo:101: Request processed in 113us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178998.985053:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788178998.985099:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471973760:0@lo:101: 00010000:00010000:1.0:1788178998.985114:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c49893e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498945 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178998.985123:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c49893e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498945 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178998.985175:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471973888:0@lo:501: 00000100:00100000:1.0:1788178998.987688:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178998.987736:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9357d7480 going to sleep for 11 seconds 00000100:00100000:1.0:1788178998.987758:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471973888 00000100:00100000:1.0:1788178998.988630:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471973888 00000100:00100000:1.0:1788178998.988706:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788178998.988718:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+14:5793:x1875041471973888:12345-0@lo:501: 00000100:00100000:1.0:1788178998.991423:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+14:5793:x1875041471973888:12345-0@lo:501: Request processed in 1475us (2509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178998.991440:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788178998.992299:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471973888:0@lo:501: 00000100:00100000:2.0:1788178998.992377:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471974016:0@lo:503: 00000100:00100000:2.0:1788178998.992448:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788178998.992492:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e8e86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788178998.992674:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471974016 00000100:00100000:1.0:1788178998.992681:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471974016 00000100:00100000:1.0:1788178998.992731:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788178998.992741:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+14:5793:x1875041471974016:12345-0@lo:503: 00000100:00100000:1.0:1788178998.996074:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+14:5793:x1875041471974016:12345-0@lo:503: Request processed in 3325us (3616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178998.996089:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788178998.996443:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471974016:0@lo:503: 00000100:00100000:0.0:1788178999.007680:0:7770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:7770:1875041471974144:0@lo:502: 00000100:00100000:0.0:1788178999.008295:0:7770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178999.008401:0:7770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc902ea6240 going to sleep for 11 seconds 00000100:00100000:1.0:1788178999.011958:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471974144 00000100:00100000:1.0:1788178999.011974:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471974144 00000100:00100000:1.0:1788178999.012039:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788178999.012050:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+14:7770:x1875041471974144:12345-0@lo:502: 00000100:00100000:1.0:1788178999.016918:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+14:7770:x1875041471974144:12345-0@lo:502: Request processed in 4861us (8614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178999.016933:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788178999.018198:0:7770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:7770:1875041471974144:0@lo:502: 00000100:00100000:0.0:1788178999.018282:0:7770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:7770:1875041471974272:0@lo:502: 00000100:00100000:0.0:1788178999.018347:0:7770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178999.018378:0:7770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc902ea6240 going to sleep for 11 seconds 00000100:00100000:1.0:1788178999.018505:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471974272 00000100:00100000:1.0:1788178999.018512:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471974272 00000100:00100000:1.0:1788178999.018622:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788178999.018632:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+14:7770:x1875041471974272:12345-0@lo:502: 00000100:00100000:1.0:1788178999.019012:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+14:7770:x1875041471974272:12345-0@lo:502: Request processed in 380us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178999.019020:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788178999.019107:0:7770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:7770:1875041471974272:0@lo:502: 00000040:00080000:3.0:1788178999.019129:0:7770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788178999.019904:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788178999.019930:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788178999.019940:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c49893e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498945 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178999.019952:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c49893e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498945 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788178999.019962:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788178999.019964:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788178999.019968:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788178999.019997:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c49894c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178999.020005:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c49894c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178999.020015:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c49894c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178999.020032:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bfa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471974400:0@lo:101: 00000100:00100000:1.0:1788178999.020073:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178999.020100:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc902f9b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788178999.020116:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471974400 00000100:00100000:1.0:1788178999.020120:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471974400 00000100:00100000:1.0:1788178999.020151:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788178999.020159:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+14:5793:x1875041471974400:12345-0@lo:101: 00010000:00010000:1.0:1788178999.020170:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788178999.020183:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc91317f200/0xaa4c98508c498953 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c49894c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178999.020228:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc91317f200/0xaa4c98508c498953 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c49894c expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178999.020239:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc91317f200/0xaa4c98508c498953 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c49894c expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178999.020248:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317f200, rc 0) 00000100:00100000:1.0:1788178999.020279:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+15:5793:x1875041471974400:12345-0@lo:101: Request processed in 121us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178999.020285:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788178999.020319:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bfa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471974400:0@lo:101: 00010000:00010000:1.0:1788178999.022679:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c49894c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498953 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178999.022699:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c49894c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498953 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178999.022945:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bfa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471974528:0@lo:501: 00000100:00100000:1.0:1788178999.023010:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178999.023105:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc902f9b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788178999.027805:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471974528 00000100:00100000:0.0:1788178999.027820:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471974528 00000100:00100000:1.0:1788178999.028021:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788178999.028032:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+15:5793:x1875041471974528:12345-0@lo:501: 00000100:00100000:1.0:1788178999.028341:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+15:5793:x1875041471974528:12345-0@lo:501: Request processed in 311us (5330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178999.028350:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788178999.028391:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bfa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471974528:0@lo:501: 00000100:00100000:1.0:1788178999.028452:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bfa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471974656:0@lo:503: 00000100:00100000:1.0:1788178999.028495:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178999.028521:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc902f9b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788178999.028546:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471974656 00000100:00100000:1.0:1788178999.028550:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471974656 00000100:00100000:1.0:1788178999.028568:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788178999.028573:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+15:5793:x1875041471974656:12345-0@lo:503: 00000100:00100000:1.0:1788178999.028845:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+15:5793:x1875041471974656:12345-0@lo:503: Request processed in 270us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178999.028881:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788178999.028917:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bfa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471974656:0@lo:503: 00000100:00100000:1.0:1788178999.029144:0:7771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bfa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:7771:1875041471974784:0@lo:502: 00000100:00100000:1.0:1788178999.029178:0:7771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178999.029198:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471974784 00000100:00100000:1.0:1788178999.029202:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471974784 00000100:00100000:1.0:1788178999.029234:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788178999.029241:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+15:7771:x1875041471974784:12345-0@lo:502: 00000100:00100000:1.0:1788178999.029394:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+15:7771:x1875041471974784:12345-0@lo:502: Request processed in 153us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178999.029401:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788178999.029430:0:7771:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc902f9b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788178999.029442:0:7771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bfa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:7771:1875041471974784:0@lo:502: 00000020:01000000:1.0:1788178999.029462:0:7771:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788178999.029470:0:7771:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788178999.029472:0:7771:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788178999.029476:0:7771:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788178999.029483:0:7771:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788178999.029497:0:7771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bfa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:7771:1875041471974912:0@lo:502: 00000100:00100000:1.0:1788178999.029528:0:7771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178999.029545:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471974912 00000100:00100000:1.0:1788178999.029548:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471974912 00000100:00100000:1.0:1788178999.029567:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788178999.029573:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+15:7771:x1875041471974912:12345-0@lo:502: 00000100:00100000:1.0:1788178999.029672:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+15:7771:x1875041471974912:12345-0@lo:502: Request processed in 99us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178999.029679:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788178999.029704:0:7771:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc902f9b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788178999.029714:0:7771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bfa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:7771:1875041471974912:0@lo:502: 00000020:01000000:1.0:1788178999.029730:0:7771:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788178999.029733:0:7771:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788178999.029735:0:7771:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788178999.029738:0:7771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1788178999.029779:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788178999.029791:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788178999.029799:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c49894c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498953 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178999.029809:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c49894c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498953 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788178999.029818:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788178999.029821:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9bc9070e2800 from 30 10000000:01000000:1.0:1788178999.029824:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788178999.029846:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317fa00/0xaa4c98508c49895a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178999.029882:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc91317fa00/0xaa4c98508c49895a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178999.029892:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc91317fa00/0xaa4c98508c49895a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178999.029904:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bfa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471975040:0@lo:101: 00000100:00100000:1.0:1788178999.029928:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178999.029939:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc902f9b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788178999.029950:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471975040 00000100:00100000:1.0:1788178999.029953:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471975040 00000100:00100000:1.0:1788178999.029972:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788178999.029978:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+15:5793:x1875041471975040:12345-0@lo:101: 00010000:00010000:1.0:1788178999.029985:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788178999.029997:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc91317e400/0xaa4c98508c498961 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c49895a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178999.030016:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc91317e400/0xaa4c98508c498961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c49895a expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178999.030024:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc91317e400/0xaa4c98508c498961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c49895a expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178999.030032:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317e400, rc 0) 00000100:00100000:1.0:1788178999.030057:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+16:5793:x1875041471975040:12345-0@lo:101: Request processed in 79us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178999.030063:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788178999.030091:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bfa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471975040:0@lo:101: 00010000:00010000:1.0:1788178999.030108:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc91317fa00/0xaa4c98508c49895a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498961 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178999.030117:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc91317fa00/0xaa4c98508c49895a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498961 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178999.030153:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bfa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471975168:0@lo:501: 00000100:00100000:1.0:1788178999.030177:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178999.030189:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc902f9b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788178999.030200:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471975168 00000100:00100000:1.0:1788178999.030213:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471975168 00000100:00100000:1.0:1788178999.030234:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788178999.030240:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+16:5793:x1875041471975168:12345-0@lo:501: 00000100:00100000:1.0:1788178999.030453:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+16:5793:x1875041471975168:12345-0@lo:501: Request processed in 212us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178999.030482:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788178999.030510:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bfa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471975168:0@lo:501: 00000100:00100000:1.0:1788178999.030533:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bfa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471975296:0@lo:503: 00000100:00100000:1.0:1788178999.030565:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178999.030578:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc902f9b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788178999.030588:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471975296 00000100:00100000:1.0:1788178999.030591:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471975296 00000100:00100000:1.0:1788178999.030610:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788178999.030616:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+16:5793:x1875041471975296:12345-0@lo:503: 00000100:00100000:1.0:1788178999.030731:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+16:5793:x1875041471975296:12345-0@lo:503: Request processed in 114us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178999.030737:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788178999.030777:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bfa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471975296:0@lo:503: 00000100:00100000:0.0:1788178999.035820:0:7772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:7772:1875041471975424:0@lo:502: 00000100:00100000:0.0:1788178999.035936:0:7772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178999.035975:0:7772:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc902ea69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788178999.036098:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471975424 00000100:00100000:1.0:1788178999.036106:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471975424 00000100:00100000:1.0:1788178999.036159:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788178999.036170:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+16:7772:x1875041471975424:12345-0@lo:502: 00000100:00100000:1.0:1788178999.036434:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+16:7772:x1875041471975424:12345-0@lo:502: Request processed in 265us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178999.036442:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788178999.036682:0:7772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:7772:1875041471975424:0@lo:502: 00000100:00100000:0.0:1788178999.036732:0:7772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:7772:1875041471975552:0@lo:502: 00000100:00100000:0.0:1788178999.036787:0:7772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178999.036817:0:7772:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc902ea69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788178999.036944:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471975552 00000100:00100000:1.0:1788178999.036950:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471975552 00000100:00100000:1.0:1788178999.036971:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788178999.036976:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+16:7772:x1875041471975552:12345-0@lo:502: 00000100:00100000:1.0:1788178999.037105:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+16:7772:x1875041471975552:12345-0@lo:502: Request processed in 127us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178999.037111:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788178999.037193:0:7772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:7772:1875041471975552:0@lo:502: 00000040:00080000:0.0:1788178999.037222:0:7772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788178999.037403:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788178999.037425:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788178999.037434:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317fa00/0xaa4c98508c49895a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498961 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178999.037445:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc91317fa00/0xaa4c98508c49895a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498961 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788178999.037455:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788178999.037458:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9bc9070e2800 from 5 10000000:01000000:1.0:1788178999.037461:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788178999.037489:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317e000/0xaa4c98508c498968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178999.037509:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc91317e000/0xaa4c98508c498968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178999.037518:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc91317e000/0xaa4c98508c498968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178999.037533:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bfa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471975680:0@lo:101: 00000100:00100000:1.0:1788178999.037575:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178999.037598:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e49d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788178999.037611:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471975680 00000100:00100000:1.0:1788178999.037615:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471975680 00000100:00100000:1.0:1788178999.037638:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788178999.037644:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+16:5793:x1875041471975680:12345-0@lo:101: 00010000:00010000:1.0:1788178999.037653:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788178999.037667:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc91317f800/0xaa4c98508c49896f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c498968 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178999.037687:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc91317f800/0xaa4c98508c49896f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c498968 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178999.037697:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc91317f800/0xaa4c98508c49896f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498968 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178999.037704:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317f800, rc 0) 00000100:00100000:1.0:1788178999.037731:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+17:5793:x1875041471975680:12345-0@lo:101: Request processed in 87us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178999.037738:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788178999.037778:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bfa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471975680:0@lo:101: 00010000:00010000:1.0:1788178999.037798:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc91317e000/0xaa4c98508c498968 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c49896f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178999.037806:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc91317e000/0xaa4c98508c498968 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c49896f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178999.037870:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bfa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471975808:0@lo:256: 00000100:00100000:1.0:1788178999.037902:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178999.037916:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e49d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788178999.037928:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471975808 00000100:00100000:1.0:1788178999.037931:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471975808 00000100:00100000:1.0:1788178999.037951:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788178999.037958:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+17:5793:x1875041471975808:12345-0@lo:256: 20000000:01000000:1.0:1788178999.037970:0:5789:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788178999.037985:0:5789:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788178999.037988:0:5789:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788178999.038062:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+17:5793:x1875041471975808:12345-0@lo:256: Request processed in 103us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178999.038068:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788178999.038097:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bfa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471975808:0@lo:256: 10000000:01000000:1.0:1788178999.038133:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788178999.038139:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317e000/0xaa4c98508c498968 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c49896f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178999.038146:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc91317e000/0xaa4c98508c498968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c49896f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788178999.038153:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788178999.038160:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788178999.038162:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788178999.038178:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc942172e00/0xaa4c98508c498976 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178999.038185:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc942172e00/0xaa4c98508c498976 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178999.038192:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc942172e00/0xaa4c98508c498976 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178999.038215:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bfa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471975936:0@lo:101: 00000100:00100000:1.0:1788178999.038240:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178999.038254:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e49d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788178999.038265:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471975936 00000100:00100000:1.0:1788178999.038268:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471975936 00000100:00100000:1.0:1788178999.038288:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788178999.038295:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+17:5793:x1875041471975936:12345-0@lo:101: 00010000:00010000:1.0:1788178999.038301:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788178999.038310:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc942173e00/0xaa4c98508c49897d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c498976 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178999.038324:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc942173e00/0xaa4c98508c49897d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c498976 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178999.038584:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc942173e00/0xaa4c98508c49897d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498976 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178999.038592:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc942173e00, rc 0) 00000100:00100000:1.0:1788178999.038622:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041471975936:12345-0@lo:101: Request processed in 327us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178999.038634:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788178999.038670:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bfa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471975936:0@lo:101: 00010000:00010000:1.0:1788178999.038681:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc942172e00/0xaa4c98508c498976 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c49897d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788178999.038688:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc942172e00/0xaa4c98508c498976 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c49897d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788178999.038729:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bfa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471976064:0@lo:501: 00000100:00100000:1.0:1788178999.038753:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178999.038922:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e49d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788178999.038936:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471976064 00000100:00100000:1.0:1788178999.038940:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471976064 00000100:00100000:1.0:1788178999.038973:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788178999.038981:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041471976064:12345-0@lo:501: 00000100:00100000:1.0:1788178999.039225:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041471976064:12345-0@lo:501: Request processed in 243us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178999.039232:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788178999.039259:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bfa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471976064:0@lo:501: 00000100:00100000:1.0:1788178999.039285:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bfa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471976192:0@lo:503: 00000100:00100000:1.0:1788178999.039319:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178999.039618:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e49d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788178999.043062:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471976192 00000100:00100000:0.0:1788178999.043077:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471976192 00000100:00100000:0.0:1788178999.043143:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788178999.043153:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041471976192:12345-0@lo:503: 00000100:00100000:0.0:1788178999.043733:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041471976192:12345-0@lo:503: Request processed in 579us (4409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178999.043742:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788178999.043937:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bfa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471976192:0@lo:503: 00000100:00100000:2.0:1788178999.044354:0:7773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:7773:1875041471976320:0@lo:502: 00000100:00100000:2.0:1788178999.044404:0:7773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788178999.044444:0:7773:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9054b4600 going to sleep for 11 seconds 00000100:00100000:3.0:1788178999.044549:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471976320 00000100:00100000:3.0:1788178999.044555:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471976320 00000100:00100000:3.0:1788178999.044590:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788178999.044598:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+18:7773:x1875041471976320:12345-0@lo:502: 00000100:00100000:3.0:1788178999.045005:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+18:7773:x1875041471976320:12345-0@lo:502: Request processed in 406us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178999.045013:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788178999.045216:0:7773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:7773:1875041471976320:0@lo:502: 00000020:01000000:2.0:1788178999.045245:0:7773:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788178999.045252:0:7773:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788178999.045259:0:7773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788178999.045261:0:7773:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788178999.045266:0:7773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788178999.045270:0:7773:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.102@tcp to nid 0x20000c0a8ca66 (192.168.202.102@tcp) 00000020:01000000:2.0:1788178999.045294:0:7773:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788178999.045299:0:7773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788178999.045316:0:7773:0:(genops.c:414:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9bc93b67b380) 00000020:00000080:2.0:1788178999.045350:0:7773:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788178999.045356:0:7773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788178999.045426:0:7773:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788178999.045431:0:7773:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788178999.045445:0:7773:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa4c98508c49898b 00010000:00080000:2.0:1788178999.045484:0:7773:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bc8019ef800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.102@tcp at head 00010000:00010000:2.0:1788178999.045939:0:7773:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1788178999.046294:0:7773:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788178999.046308:0:7773:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788178999.050315:0:7773:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788178999.050948:0:7773:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788178999.051003:0:7773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788178999.051064:0:7773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000020:00000080:1.0:1788178999.060441:0:7773:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788178999.060455:0:7773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788178999.060486:0:7773:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788178999.060509:0:7773:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa4c98508c498992 00000100:00080000:1.0:1788178999.060534:0:7773:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788178999.060553:0:7773:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bc8019ef800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:1.0:1788178999.060587:0:7773:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bc934bf8700 x1875041471976448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788178999.060613:0:7773:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788178999.060668:0:7773:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788178999.060673:0:7773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788178999.060674:0:7773:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788178999.060678:0:7773:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788178999.060681:0:7773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788178999.060682:0:7773:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788178999.060685:0:7773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788178999.060687:0:7773:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788178999.060714:0:7773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bfb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:7773:1875041471976576:0@lo:502: 00000100:00100000:1.0:1788178999.060800:0:7773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178999.060833:0:7773:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e49d180 going to sleep for 11 seconds 00000100:00100000:0.0:1788178999.061115:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875041471976448:0@lo:8: 00000100:00100000:0.0:1788178999.061150:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178999.061476:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471976576 00000100:00100000:3.0:1788178999.061489:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471976576 00000100:00100000:3.0:1788178999.061532:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788178999.061610:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875041471976704:0@lo:400: 00000100:00100000:0.0:1788178999.061640:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178999.061663:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788178999.061669:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041471977088:0@lo:400: 00000100:00100000:0.0:1788178999.061692:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178999.061718:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471976704 00000100:00100000:0.0:1788178999.061722:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471976704 00000100:00100000:0.0:1788178999.061748:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471977088 00000100:00100000:0.0:1788178999.061751:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471977088 00000100:00100000:0.0:1788178999.061792:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788178999.061800:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875041471976704:12345-0@lo:400: 00000100:00100000:0.0:1788178999.061898:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875041471976704:12345-0@lo:400: Request processed in 49us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178999.061906:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788178999.061924:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788178999.061931:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041471977088:12345-0@lo:400: 00000100:00100000:0.0:1788178999.061959:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041471977088:12345-0@lo:400: Request processed in 29us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178999.061964:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788178999.061986:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788178999.062022:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93539d500 x1875041471977088/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788178999.062036:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041471977088:0@lo:400: 00010000:00080000:0.0:1788178999.062047:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93539dc00 x1875041471976704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788178999.062055:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875041471976704:0@lo:400: 00000100:00100000:3.0:1788178999.062314:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+18:7773:x1875041471976576:12345-0@lo:502: 00000100:00100000:1.0:1788178999.062761:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471976448 00000100:00100000:3.0:1788178999.062944:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+18:7773:x1875041471976576:12345-0@lo:502: Request processed in 631us (2142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178999.062953:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788178999.063036:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041471976832:0@lo:400: 00000100:00100000:3.0:1788178999.063066:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178999.063090:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788178999.063097:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471976960:0@lo:400: 00000100:00100000:3.0:1788178999.063117:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178999.063150:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471976960 00000100:00100000:3.0:1788178999.063155:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471976960 00000100:00100000:1.0:1788178999.063282:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471976448 00000100:00100000:3.0:1788178999.063310:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788178999.063320:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471976960:12345-0@lo:400: 00000100:00100000:3.0:1788178999.063425:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471976960:12345-0@lo:400: Request processed in 106us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178999.063810:0:7773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bfb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:7773:1875041471976576:0@lo:502: 00000020:01000000:0.0:1788178999.063842:0:7773:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788178999.063864:0:7773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788178999.063867:0:7773:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788178999.063871:0:7773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:1.0:1788178999.066542:0:6590:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788178999.066562:0:6590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788178999.068714:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788178999.068728:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1875041471976448:12345-0@lo:8: 00010000:00080000:1.0:1788178999.068786:0:6590:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:1.0:1788178999.068821:0:6590:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa4c98508c498999 00002000:00100000:1.0:1788178999.068838:0:6590:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9bc92e132800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211371b ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788178999.068843:0:6590:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788178999.068862:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788178999.068982:0:6590:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788178999.069152:0:6590:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788178999.069182:0:6590:0:(import.c:65:import_set_state_nolock()) ffff9bc92e137000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788178999.069291:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875041471976448:12345-0@lo:8: Request processed in 563us (8138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178999.069299:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788178999.070702:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc934bf8700 x1875041471976448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788179009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788178999.070718:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788178999.070728:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788178999.070737:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788178999.070744:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788178999.070747:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9bc8019ef800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788178999.070967:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788178999.070975:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875041471976448:0@lo:8: 00000100:00080000:1.0:1788178999.071954:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788178999.071974:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471976832 00000100:00100000:1.0:1788178999.071981:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471976832 00000100:00100000:1.0:1788178999.072033:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788178999.072043:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041471976832:12345-0@lo:400: 00000100:00100000:1.0:1788178999.072120:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041471976832:12345-0@lo:400: Request processed in 79us (9053us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178999.072128:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788178999.072145:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788178999.072227:0:7776:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788178999.072232:0:7776:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000004:00080000:1.0:1788178999.072265:0:7776:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788178999.072480:0:7776:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 195135629190ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788178999.074429:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788178999.075257:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93539c000 x1875041471976960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788178999.075274:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471976960:0@lo:400: 00010000:00080000:3.0:1788178999.075288:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93539ed80 x1875041471976832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788178999.075296:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041471976832:0@lo:400: 00000020:01000000:3.0:1788178999.075589:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788178999.075615:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788178999.075634:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc942172e00/0xaa4c98508c498976 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c49897d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178999.075646:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc942172e00/0xaa4c98508c498976 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c49897d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788178999.075656:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788178999.075658:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9bc9265819c0 from 1 10000000:01000000:3.0:1788178999.075661:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788178999.075694:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4200/0xaa4c98508c4989a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178999.075702:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4200/0xaa4c98508c4989a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788178999.075713:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4200/0xaa4c98508c4989a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788178999.075732:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471977216:0@lo:101: 00000100:00100000:3.0:1788178999.076015:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788178999.076126:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93fadc300 going to sleep for 11 seconds 00000100:00100000:0.0:1788178999.080031:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471977216 00000100:00100000:0.0:1788178999.080041:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471977216 00000100:00100000:0.0:1788178999.080089:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788178999.080097:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041471977216:12345-0@lo:101: 00010000:00010000:0.0:1788178999.080113:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788178999.080129:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc900030e00/0xaa4c98508c4989a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c4989a0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178999.080161:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc900030e00/0xaa4c98508c4989a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c4989a0 expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178999.080172:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc900030e00/0xaa4c98508c4989a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c4989a0 expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178999.080181:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc900030e00, rc 0) 00000100:00100000:0.0:1788178999.080273:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:5793:x1875041471977216:12345-0@lo:101: Request processed in 177us (4259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788178999.080280:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788178999.080348:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471977216:0@lo:101: 00010000:00010000:0.0:1788178999.080366:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4200/0xaa4c98508c4989a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c4989a7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178999.080375:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4200/0xaa4c98508c4989a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c4989a7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788178999.080441:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471977344:0@lo:501: 00000100:00100000:0.0:1788178999.080473:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178999.080502:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc902ea6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788178999.080515:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471977344 00000100:00100000:0.0:1788178999.080518:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471977344 00000100:00100000:1.0:1788178999.080918:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788178999.080927:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:5793:x1875041471977344:12345-0@lo:501: 00000100:00100000:1.0:1788178999.081122:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:5793:x1875041471977344:12345-0@lo:501: Request processed in 196us (648us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788178999.081130:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788178999.081273:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471977344:0@lo:501: 10000000:01000000:0.0:1788178999.081299:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788178999.081306:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4200/0xaa4c98508c4989a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c4989a7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788178999.081334:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4200/0xaa4c98508c4989a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c4989a7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788178999.127772:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788178999.131409:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:1.0:1788178999.132405:0:7777:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788178999.132445:0:7777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bfb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7777:1875041471977600:0@lo:7: 00000100:00100000:1.0:1788178999.132514:0:7777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178999.132571:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471977600 00000100:00100000:1.0:1788178999.132584:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471977600 00000100:00100000:1.0:1788178999.132632:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788178999.132639:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7777:x1875041471977600:12345-0@lo:7: 00000100:00080000:2.0:1788178999.136436:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788178999.137859:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471977472:0@lo:13: 00000100:00100000:3.0:1788178999.137941:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788178999.145441:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471977472 00000100:00100000:2.0:1788178999.145455:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471977472 00002000:00080000:1.0:1788178999.149432:0:6590:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788178999.149444:0:6590:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788178999.149530:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7777:x1875041471977600:12345-0@lo:7: Request processed in 16886us (17011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788178999.149541:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788178999.149589:0:7777:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc903d66480 going to sleep for 11 seconds 00010000:00080000:1.0:1788178999.149617:0:7777:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc934bfb100 x1875041471977600/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788179015 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788178999.149632:0:7777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bfb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7777:1875041471977600:0@lo:7: 00000004:00080000:1.0:1788178999.149646:0:7777:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788178999.149683:0:7777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bfb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7777:1875041471977728:0@lo:5: 00000100:00100000:1.0:1788178999.149717:0:7777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178999.149747:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471977728 00000100:00100000:1.0:1788178999.149752:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471977728 00000100:00100000:3.0:1788178999.150020:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788178999.150030:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875041471977472:12345-0@lo:13: 00002000:00000024:3.0:1788178999.150055:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788178999.150096:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875041471977472:12345-0@lo:13: Request processed in 68us (12156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178999.150116:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788178999.150146:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc934bfa300 x1875041471977472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788178999.150172:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471977472:0@lo:13: 00000100:00100000:1.0:1788178999.150496:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788178999.150506:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7777:x1875041471977728:12345-0@lo:5: 00002000:00080000:1.0:1788178999.150525:0:6589:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788178999.150529:0:6589:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788178999.150800:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7777:x1875041471977728:12345-0@lo:5: Request processed in 296us (1082us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788178999.150807:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788178999.150834:0:7777:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93fb0cc00 going to sleep for 11 seconds 00010000:00080000:1.0:1788178999.150863:0:7777:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc934bfb100 x1875041471977728/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788179015 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788178999.150874:0:7777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bfb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7777:1875041471977728:0@lo:5: 00000004:00080000:1.0:1788178999.150892:0:7777:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788178999.150920:0:7777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bf9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7777:1875041471977856:0@lo:700: 00000100:00100000:1.0:1788178999.150945:0:7777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788178999.150969:0:7777:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93fb0cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788178999.151034:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471977856 00000100:00100000:2.0:1788178999.151040:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471977856 00000100:00100000:2.0:1788178999.151076:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788178999.151084:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7777:x1875041471977856:12345-0@lo:700: 00000100:00100000:2.0:1788178999.151113:0:6598:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6598:1875041471977984:0@lo:700: 00000100:00100000:2.0:1788178999.151238:0:6598:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788178999.151259:0:6598:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93213be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788178999.151274:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471977984 00000100:00100000:2.0:1788178999.151278:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471977984 00000100:00100000:2.0:1788178999.151305:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788178999.151312:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6598:x1875041471977984:12345-0@lo:700: 40000000:02000000:2.0:1788178999.215027:0:5803:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1788178999.236931:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6598:x1875041471977984:12345-0@lo:700: Request processed in 85612us (85765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178999.236947:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788178999.237128:0:6598:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc910b9ca80 x1875041471977984/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788179015 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788178999.237143:0:6598:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6598:1875041471977984:0@lo:700: 40000000:02000000:2.0:1788178999.237256:0:6598:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:3.0:1788178999.353692:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7777:x1875041471977856:12345-0@lo:700: Request processed in 202598us (202734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788178999.353714:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788178999.353922:0:7777:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc934bf9880 x1875041471977856/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788179015 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788178999.353939:0:7777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bf9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7777:1875041471977856:0@lo:700: 00000001:00080000:0.0:1788178999.358908:0:7496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1788178999.358929:0:7496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:1.0:1788178999.429344:0:7777:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1788178999.436318:0:7777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7777:1875041471978112:0@lo:5: 00000100:00100000:0.0:1788178999.436391:0:7777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788178999.436447:0:7777:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc8013bfcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788178999.437566:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471978112 00000100:00100000:0.0:1788178999.437576:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471978112 00000100:00100000:0.0:1788178999.437651:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788178999.437662:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:7777:x1875041471978112:12345-0@lo:5: 00002000:00080000:0.0:1788178999.445021:0:7778:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788178999.445040:0:7778:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1788178999.455967:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:7777:x1875041471978112:12345-0@lo:5: Request processed in 18298us (19566us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788178999.455980:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788178999.458909:0:7777:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e0c4380 x1875041471978112/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788179015 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788178999.458928:0:7777:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788178999.458958:0:7777:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9bc92e0c4380 x1875041471978112/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788179015 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788178999.458970:0:7777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7777:1875041471978112:0@lo:5: 00000004:00080000:2.0:1788178999.458988:0:7777:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1788178999.554515:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179000.578916:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788179000.647982:0:7844:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788179001.600035:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179002.627601:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179003.072109:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471978240:0@lo:13: 00000100:00100000:0.0:1788179003.072219:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179003.072358:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471978240 00000100:00100000:1.0:1788179003.072368:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471978240 00000100:00100000:1.0:1788179003.072438:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788179003.072449:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471978240:12345-0@lo:13: 00002000:00000024:1.0:1788179003.072486:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788179003.072578:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788179003.077346:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471978240:12345-0@lo:13: Request processed in 4888us (5116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179003.077362:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788179003.080888:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93539d500 x1875041471978240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179003.080922:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471978240:0@lo:13: 00010000:00010000:0.0:1788179003.648449:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179004.099619:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041471978496:0@lo:400: 00000100:00100000:3.0:1788179004.099699:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179004.099767:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471979008:0@lo:400: 00000100:00100000:3.0:1788179004.099795:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179004.099825:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788179004.099831:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875041471978624:0@lo:400: 00000100:00100000:3.0:1788179004.099900:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179004.099937:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471978496 00000100:00100000:3.0:1788179004.099946:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471978496 00000100:00100000:3.0:1788179004.099986:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471978624 00000100:00100000:3.0:1788179004.099989:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471978624 00000100:00100000:3.0:1788179004.100017:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788179004.100026:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041471978496:12345-0@lo:400: 00000100:00100000:3.0:1788179004.100074:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041471978496:12345-0@lo:400: Request processed in 50us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179004.100251:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041471978368:0@lo:400: 00000100:00100000:1.0:1788179004.100287:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179004.100314:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875041471978880:0@lo:400: 00000100:00100000:1.0:1788179004.100336:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179004.100348:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788179004.100353:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041471978752:0@lo:400: 00000100:00100000:1.0:1788179004.100373:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179004.100401:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471979008 00000100:00100000:1.0:1788179004.100411:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471979008 00000100:00100000:1.0:1788179004.100441:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471978752 00000100:00100000:1.0:1788179004.100443:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471978752 00000100:00100000:1.0:1788179004.100462:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788179004.100467:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875041471979008:12345-0@lo:400: 00000100:00100000:1.0:1788179004.100498:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875041471979008:12345-0@lo:400: Request processed in 31us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179004.100505:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788179004.100523:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788179004.100529:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041471978752:12345-0@lo:400: 00000100:00100000:1.0:1788179004.100558:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041471978752:12345-0@lo:400: Request processed in 30us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179004.100563:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788179004.100579:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471978880 00000100:00100000:1.0:1788179004.100583:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471978880 00000100:00100000:1.0:1788179004.100598:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788179004.100604:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875041471978624:12345-0@lo:400: 00000100:00100000:1.0:1788179004.100631:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875041471978624:12345-0@lo:400: Request processed in 27us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179004.100636:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788179004.100646:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788179004.100651:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875041471978880:12345-0@lo:400: 00000100:00100000:1.0:1788179004.100671:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875041471978880:12345-0@lo:400: Request processed in 21us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179004.100677:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788179004.100691:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471978368 00000100:00100000:1.0:1788179004.100694:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471978368 00000100:00100000:1.0:1788179004.100728:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788179004.100740:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+19:3306:x1875041471978368:12345-0@lo:400: 00000100:00100000:1.0:1788179004.100769:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+19:3306:x1875041471978368:12345-0@lo:400: Request processed in 29us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179004.100774:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:1.0:1788179004.100826:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93539ce00 x1875041471978752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788179004.100840:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041471978752:0@lo:400: 00000100:00100000:1.0:1788179004.100872:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041471978368:0@lo:400: 00010000:00080000:1.0:1788179004.100883:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93539c700 x1875041471978880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788179004.100891:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875041471978880:0@lo:400: 00000100:00100000:3.0:1788179004.101125:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788179004.101168:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93539e300 x1875041471978624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179004.101177:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875041471978624:0@lo:400: 00010000:00080000:3.0:1788179004.101187:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93539d180 x1875041471978496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179004.101194:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041471978496:0@lo:400: 00010000:00080000:3.0:1788179004.101203:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93539f800 x1875041471979008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179004.101212:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471979008:0@lo:400: 00000100:00080000:2.0:1788179004.101388:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788179004.101393:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788179004.616137:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041471979136:0@lo:13: 00000100:00100000:0.0:1788179004.616229:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179004.616321:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471979136 00000100:00100000:0.0:1788179004.616330:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471979136 00000100:00100000:0.0:1788179004.616382:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788179004.616392:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875041471979136:12345-0@lo:13: 00002000:00000024:0.0:1788179004.616427:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788179004.616472:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875041471979136:12345-0@lo:13: Request processed in 82us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179004.616480:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788179004.616526:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e0c7800 x1875041471979136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179020 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179004.616546:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041471979136:0@lo:13: 00010000:00010000:2.0:1788179004.677041:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788179004.722711:0:7496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1788179005.696623:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179006.730400:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179007.693474:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179007.693633:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450983808 00000100:00100000:0.0:1788179007.693643:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450983808 00000100:00100000:0.0:1788179007.693687:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 112 00000100:00100000:0.0:1788179007.693694:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2353:x1875041450983808:12345-192.168.202.2@tcp:250: 00010000:00080000:0.0:1788179007.693718:0:5791:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from acb73c7e-aaaf-4666-a05e-a4b9911fcad0@192.168.202.2@tcp t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:0.0:1788179007.693743:0:5791:0:(genops.c:1407:class_connect()) connect: client acb73c7e-aaaf-4666-a05e-a4b9911fcad0, cookie 0xaa4c98508c4989ae 00000100:00080000:0.0:1788179007.693841:0:5791:0:(import.c:65:import_set_state_nolock()) ffff9bc9267f7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788179007.693963:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+5:2353:x1875041450983808:12345-192.168.202.2@tcp:250: Request processed in 268us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179007.693968:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 112 00000100:00100000:3.0:1788179007.706588:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179007.706829:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450983680 00000100:00100000:1.0:1788179007.706840:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450983680 00000100:00100000:1.0:1788179007.706928:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 113 00000100:00100000:1.0:1788179007.706939:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+5:5558:x1875041450983680:12345-192.168.202.2@tcp:101: 00010000:00010000:1.0:1788179007.706964:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179007.706983:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc942172400/0xaa4c98508c4989b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x34c7c42474661e58 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179007.707011:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc942172400/0xaa4c98508c4989b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e58 expref: 6 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179007.707023:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc942172400/0xaa4c98508c4989b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e58 expref: 6 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179007.707246:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc942172400, rc 0) 00000100:00100000:1.0:1788179007.707321:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+6:5558:x1875041450983680:12345-192.168.202.2@tcp:101: Request processed in 383us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179007.707328:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 113 00000100:00100000:2.0:1788179007.709922:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179007.710019:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450983936 00000100:00100000:1.0:1788179007.710029:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450983936 00000100:00100000:1.0:1788179007.710091:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 114 00000100:00100000:1.0:1788179007.710100:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+6:5558:x1875041450983936:12345-192.168.202.2@tcp:501: 00000100:00100000:1.0:1788179007.710678:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+6:5558:x1875041450983936:12345-192.168.202.2@tcp:501: Request processed in 577us (761us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788179007.710687:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 114 00000100:00100000:3.0:1788179007.724406:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179007.724570:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450984064 00000100:00100000:0.0:1788179007.724595:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450984064 00000100:00100000:0.0:1788179007.724658:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 115 00000100:00100000:0.0:1788179007.724667:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+6:5558:x1875041450984064:12345-192.168.202.2@tcp:101: 00010000:00010000:0.0:1788179007.724683:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179007.724715:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc900030400/0xaa4c98508c4989bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x34c7c42474661e5f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179007.724742:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc900030400/0xaa4c98508c4989bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e5f expref: 7 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179007.724753:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc900030400/0xaa4c98508c4989bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e5f expref: 7 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179007.724762:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc900030400, rc 0) 00000100:00100000:0.0:1788179007.724828:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+7:5558:x1875041450984064:12345-192.168.202.2@tcp:101: Request processed in 161us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179007.724834:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 115 00000100:00100000:3.0:1788179007.737189:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179007.737624:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450984192 00000100:00100000:1.0:1788179007.737635:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450984192 00000100:00100000:1.0:1788179007.737693:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 116 00000100:00100000:1.0:1788179007.737703:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+7:5558:x1875041450984192:12345-192.168.202.2@tcp:501: 00000100:00100000:1.0:1788179007.738043:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+8:5558:x1875041450984192:12345-192.168.202.2@tcp:501: Request processed in 340us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179007.738052:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 116 00000100:00100000:1.0:1788179007.741229:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179007.741539:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450984320 00000100:00100000:2.0:1788179007.741549:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450984320 00000100:00100000:2.0:1788179007.741607:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 117 00000100:00100000:2.0:1788179007.741617:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+8:5558:x1875041450984320:12345-192.168.202.2@tcp:503: 00000100:00100000:2.0:1788179007.742020:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+8:5558:x1875041450984320:12345-192.168.202.2@tcp:503: Request processed in 403us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179007.742038:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 117 00000100:00100000:3.0:1788179007.751767:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179007.751932:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450984448 00000100:00100000:1.0:1788179007.751942:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450984448 00000100:00100000:1.0:1788179007.752018:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 118 00000100:00100000:1.0:1788179007.752029:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+8:5576:x1875041450984448:12345-192.168.202.2@tcp:502: 00000100:00100000:1.0:1788179007.752461:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+8:5576:x1875041450984448:12345-192.168.202.2@tcp:502: Request processed in 432us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179007.752470:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 118 00010000:00010000:0.0:1788179007.759804:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179007.792985:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179007.793097:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450984576 00000100:00100000:0.0:1788179007.793108:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450984576 00000100:00100000:0.0:1788179007.793178:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 119 00000100:00100000:0.0:1788179007.793189:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+8:5576:x1875041450984576:12345-192.168.202.2@tcp:502: 00000100:00100000:0.0:1788179007.793479:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+8:5576:x1875041450984576:12345-192.168.202.2@tcp:502: Request processed in 291us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179007.793489:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 119 00000100:00100000:3.0:1788179007.805959:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179007.806241:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450984704 00000100:00100000:2.0:1788179007.806252:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450984704 00000100:00100000:2.0:1788179007.806335:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 120 00000100:00100000:2.0:1788179007.806345:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90353a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+8:5558:x1875041450984704:12345-192.168.202.2@tcp:101: 00010000:00010000:2.0:1788179007.806362:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179007.806380:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9136c4400/0xaa4c98508c4989c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x34c7c42474661e89 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179007.806410:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9136c4400/0xaa4c98508c4989c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e89 expref: 9 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179007.806422:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9136c4400/0xaa4c98508c4989c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e89 expref: 9 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179007.806431:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c4400, rc 0) 00000100:00100000:2.0:1788179007.806489:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90353a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+9:5558:x1875041450984704:12345-192.168.202.2@tcp:101: Request processed in 145us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179007.806497:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 120 00000100:00100000:3.0:1788179007.809314:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179007.809463:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450984832 00000100:00100000:1.0:1788179007.809486:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450984832 00000100:00100000:1.0:1788179007.809535:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 121 00000100:00100000:1.0:1788179007.809543:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc903538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+9:5558:x1875041450984832:12345-192.168.202.2@tcp:256: 20000000:01000000:1.0:1788179007.809566:0:5791:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788179007.809582:0:5791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788179007.809594:0:5791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788179007.809597:0:5791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788179007.809600:0:5791:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788179007.811961:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc903538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+9:5558:x1875041450984832:12345-192.168.202.2@tcp:256: Request processed in 2409us (2647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179007.811974:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 121 00000100:00100000:3.0:1788179007.818243:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179007.818402:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450984960 00000100:00100000:1.0:1788179007.818412:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450984960 00000100:00100000:1.0:1788179007.818470:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 122 00000100:00100000:1.0:1788179007.818481:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90353b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+9:5558:x1875041450984960:12345-192.168.202.2@tcp:101: 00010000:00010000:1.0:1788179007.818498:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179007.818515:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc942173000/0xaa4c98508c4989ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x34c7c42474661e90 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179007.818554:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc942173000/0xaa4c98508c4989ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e90 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179007.818565:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc942173000/0xaa4c98508c4989ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e90 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179007.818574:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc942173000, rc 0) 00000100:00100000:1.0:1788179007.818635:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90353b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:5558:x1875041450984960:12345-192.168.202.2@tcp:101: Request processed in 156us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179007.818642:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 122 00000100:00100000:3.0:1788179007.823489:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179007.823583:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450985088 00000100:00100000:1.0:1788179007.823608:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450985088 00000100:00100000:1.0:1788179007.823679:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 123 00000100:00100000:1.0:1788179007.823689:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc903538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:5558:x1875041450985088:12345-192.168.202.2@tcp:501: 00000100:00100000:1.0:1788179007.824011:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc903538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:5558:x1875041450985088:12345-192.168.202.2@tcp:501: Request processed in 322us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179007.824020:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 123 00000100:00100000:3.0:1788179007.826449:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179007.826770:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450985216 00000100:00100000:2.0:1788179007.826779:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450985216 00000100:00100000:2.0:1788179007.826829:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 124 00000100:00100000:2.0:1788179007.826838:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc903538450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:5558:x1875041450985216:12345-192.168.202.2@tcp:503: 00000100:00100000:2.0:1788179007.827217:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc903538450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:5558:x1875041450985216:12345-192.168.202.2@tcp:503: Request processed in 379us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179007.827226:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 124 00000100:00100000:3.0:1788179007.838010:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179007.838109:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450985344 00000100:00100000:0.0:1788179007.838118:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450985344 00000100:00100000:0.0:1788179007.838178:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 125 00000100:00100000:0.0:1788179007.838187:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc903538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:5580:x1875041450985344:12345-192.168.202.2@tcp:502: 00000100:00100000:0.0:1788179007.838443:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc903538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:5580:x1875041450985344:12345-192.168.202.2@tcp:502: Request processed in 256us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179007.838451:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 125 00000100:00100000:3.0:1788179007.841416:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179007.841503:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450985472 00000100:00100000:1.0:1788179007.841513:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450985472 00000100:00100000:1.0:1788179007.841568:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 126 00000100:00100000:1.0:1788179007.841578:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90353b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:5580:x1875041450985472:12345-192.168.202.2@tcp:502: 00000100:00100000:1.0:1788179007.841869:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90353b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:5580:x1875041450985472:12345-192.168.202.2@tcp:502: Request processed in 271us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179007.841878:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 126 00000100:00100000:3.0:1788179007.844514:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179007.845580:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450985600 00000100:00100000:1.0:1788179007.845607:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450985600 00000100:00100000:1.0:1788179007.845656:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:1.0:1788179007.845664:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2353:x1875041450985600:12345-192.168.202.2@tcp:38: 00010000:00080000:1.0:1788179007.845693:0:5827:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 334bb25c-6762-4beb-8a84-3a838cbc7e80@192.168.202.2@tcp t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:1.0:1788179007.845754:0:5827:0:(genops.c:1407:class_connect()) connect: client 334bb25c-6762-4beb-8a84-3a838cbc7e80, cookie 0xaa4c98508c4989d1 00000004:00100000:1.0:1788179007.845784:0:5827:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788179007.845790:0:5827:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1788179007.902346:0:5827:0:(import.c:65:import_set_state_nolock()) ffff9bc93b627800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788179007.902533:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2353:x1875041450985600:12345-192.168.202.2@tcp:38: Request processed in 56865us (58024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179007.902545:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:1.0:1788179008.192445:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788179008.192472:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041471979264:0@lo:13: 00000100:00100000:1.0:1788179008.192541:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179008.192926:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471979264 00000100:00100000:0.0:1788179008.192934:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471979264 00000100:00100000:0.0:1788179008.193067:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788179008.193077:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041471979264:12345-0@lo:13: 00002000:00000024:0.0:1788179008.193115:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788179008.193187:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041471979264:12345-0@lo:13: Request processed in 111us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179008.193196:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788179008.193378:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc9358f8700 x1875041471979264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179008.193410:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041471979264:0@lo:13: 00000100:00080000:2.0:1788179008.193469:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788179008.768282:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179008.924561:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179008.924676:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450985728 00000100:00100000:0.0:1788179008.924687:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450985728 00000100:00100000:0.0:1788179008.924770:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:0.0:1788179008.924782:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:0:x1875041450985728:12345-192.168.202.2@tcp:41: 00000100:00080000:2.0:1788179008.924923:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1788179008.924988:0:5797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788179008.925297:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:0:x1875041450985728:12345-192.168.202.2@tcp:41: Request processed in 516us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179008.925304:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:2.0:1788179008.937364:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179008.937500:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450985856 00000100:00100000:0.0:1788179008.937511:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450985856 00000100:00100000:0.0:1788179008.937566:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:0.0:1788179008.937577:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:5558:x1875041450985856:12345-192.168.202.2@tcp:41: 00000004:00000024:0.0:1788179008.937621:0:5798:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788179008.937699:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:5558:x1875041450985856:12345-192.168.202.2@tcp:41: Request processed in 123us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179008.937706:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:3.0:1788179008.952324:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179008.952664:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450985984 00000100:00100000:0.0:1788179008.952677:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450985984 00000100:00100000:0.0:1788179008.952735:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:0.0:1788179008.952764:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:5558:x1875041450985984:12345-192.168.202.2@tcp:40: 00000100:00100000:0.0:1788179008.952943:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:5558:x1875041450985984:12345-192.168.202.2@tcp:40: Request processed in 182us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179008.952950:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:2.0:1788179008.960388:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179008.960449:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179008.960482:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179008.960523:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179008.960556:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450986496 00000100:00100000:2.0:1788179008.960567:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450986496 00000100:00100000:2.0:1788179008.960612:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 127 00000100:00100000:2.0:1788179008.960623:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc903539c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:2355:x1875041450986496:12345-192.168.202.2@tcp:400: 00000100:00100000:2.0:1788179008.960704:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc903539c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:2355:x1875041450986496:12345-192.168.202.2@tcp:400: Request processed in 82us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179008.960712:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 127 00000100:00100000:1.0:1788179008.960814:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450986112 00000100:00100000:1.0:1788179008.960819:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450986112 00000100:00100000:1.0:1788179008.960888:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450986240 00000100:00100000:1.0:1788179008.960892:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450986240 00000100:00100000:1.0:1788179008.960908:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:1.0:1788179008.960913:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1875041450986112:12345-192.168.202.2@tcp:8: 00010000:00080000:1.0:1788179008.960938:0:6589:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 334bb25c-6762-4beb-8a84-3a838cbc7e80@192.168.202.2@tcp t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:1.0:1788179008.960971:0:6589:0:(genops.c:1407:class_connect()) connect: client 334bb25c-6762-4beb-8a84-3a838cbc7e80, cookie 0xaa4c98508c4989d8 00002000:00100000:1.0:1788179008.960983:0:6589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 334bb25c-6762-4beb-8a84-3a838cbc7e80/ffff9bc93b625000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211371b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788179008.960995:0:6589:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788179008.961361:0:6589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788179008.961386:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9bc93b620000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788179008.961419:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2353:x1875041450986112:12345-192.168.202.2@tcp:8: Request processed in 504us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179008.961426:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:1.0:1788179008.961440:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:1.0:1788179008.961444:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1875041450986240:12345-192.168.202.2@tcp:8: 00010000:00080000:1.0:1788179008.961458:0:6589:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 334bb25c-6762-4beb-8a84-3a838cbc7e80@192.168.202.2@tcp t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:1.0:1788179008.961473:0:6589:0:(genops.c:1407:class_connect()) connect: client 334bb25c-6762-4beb-8a84-3a838cbc7e80, cookie 0xaa4c98508c4989df 00002000:00100000:1.0:1788179008.961478:0:6589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 334bb25c-6762-4beb-8a84-3a838cbc7e80/ffff9bc93b623000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211371b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788179008.961493:0:6589:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788179008.961676:0:6589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788179008.961701:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9bc93b621000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788179008.961726:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2353:x1875041450986240:12345-192.168.202.2@tcp:8: Request processed in 279us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179008.961732:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:0.0:1788179008.961901:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450986368 00000100:00100000:0.0:1788179008.961907:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450986368 00000100:00100000:0.0:1788179008.961947:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:0.0:1788179008.961954:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:5558:x1875041450986368:12345-192.168.202.2@tcp:33: 00000004:00080000:1.0:1788179008.991822:0:5799:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 29800us 00000004:00200000:2.0:1788179009.010889:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1788179009.011075:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:5558:x1875041450986368:12345-192.168.202.2@tcp:33: Request processed in 49113us (50584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179009.011089:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:1.0:1788179009.217968:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041471979392:0@lo:400: 00000100:00100000:1.0:1788179009.218046:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179009.218094:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875041471979904:0@lo:400: 00000100:00100000:1.0:1788179009.218134:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179009.218162:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788179009.218168:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041471979776:0@lo:400: 00000100:00100000:1.0:1788179009.218193:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179009.218234:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471979776 00000100:00100000:1.0:1788179009.218242:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471979776 00000100:00100000:1.0:1788179009.218290:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788179009.218301:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041471979776:12345-0@lo:400: 00000100:00100000:1.0:1788179009.218359:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041471979776:12345-0@lo:400: Request processed in 59us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179009.218366:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788179009.218410:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e0c7100 x1875041471979776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788179009.218424:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041471979776:0@lo:400: 00000100:00100000:1.0:1788179009.218463:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875041471979648:0@lo:400: 00000100:00100000:1.0:1788179009.218490:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179009.218509:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788179009.218514:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875041471979520:0@lo:400: 00000100:00100000:1.0:1788179009.218546:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179009.218564:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041471980032:0@lo:400: 00000100:00100000:1.0:1788179009.218585:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179009.218614:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471979904 00000100:00100000:1.0:1788179009.218619:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471979904 00000100:00100000:1.0:1788179009.218653:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471979648 00000100:00100000:1.0:1788179009.218657:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471979648 00000100:00100000:1.0:1788179009.218670:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471979520 00000100:00100000:1.0:1788179009.218673:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471979520 00000100:00100000:1.0:1788179009.218685:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788179009.218691:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875041471979904:12345-0@lo:400: 00000100:00100000:1.0:1788179009.218727:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875041471979904:12345-0@lo:400: Request processed in 35us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179009.218733:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788179009.218744:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788179009.218750:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875041471979648:12345-0@lo:400: 00000100:00100000:1.0:1788179009.218779:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875041471979648:12345-0@lo:400: Request processed in 30us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179009.218786:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788179009.218796:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788179009.218801:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875041471979520:12345-0@lo:400: 00000100:00100000:1.0:1788179009.218825:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875041471979520:12345-0@lo:400: Request processed in 24us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179009.218830:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788179009.218888:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788179009.218907:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e0c6300 x1875041471979520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788179009.218928:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875041471979520:0@lo:400: 00010000:00080000:1.0:1788179009.218941:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e0c6680 x1875041471979648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788179009.218950:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875041471979648:0@lo:400: 00010000:00080000:1.0:1788179009.218973:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93abb8380 x1875041471979904/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788179009.218982:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875041471979904:0@lo:400: 00000100:00100000:1.0:1788179009.219011:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471979392 00000100:00100000:1.0:1788179009.219015:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471979392 00000100:00100000:1.0:1788179009.219041:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788179009.219047:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+19:3306:x1875041471979392:12345-0@lo:400: 00000100:00100000:1.0:1788179009.219081:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+19:3306:x1875041471979392:12345-0@lo:400: Request processed in 34us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179009.219087:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788179009.219132:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041471979392:0@lo:400: 00000100:00100000:0.0:1788179009.220721:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471980032 00000100:00100000:0.0:1788179009.220733:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471980032 00000100:00100000:0.0:1788179009.220791:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788179009.220800:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041471980032:12345-0@lo:400: 00000100:00100000:0.0:1788179009.221294:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041471980032:12345-0@lo:400: Request processed in 494us (2705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179009.221302:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788179009.221357:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8d5f80 x1875041471980032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179009.221369:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788179009.221384:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041471980032:0@lo:400: 00000100:00080000:1.0:1788179009.221839:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788179009.249052:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179009.249216:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450986624 00000100:00100000:1.0:1788179009.249227:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450986624 00000100:00100000:1.0:1788179009.249294:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:1.0:1788179009.249305:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:5597:x1875041450986624:12345-192.168.202.2@tcp:101: 00010000:00010000:1.0:1788179009.249326:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179009.249399:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172200/0xaa4c98508c4989e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474661eba expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179009.249517:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c4989ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179009.249542:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c4989ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179009.249555:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c4989ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788179009.249755:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1788179009.249759:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788179009.249820:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c4989ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179009.249889:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172200/0xaa4c98508c4989e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661eba expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179009.249907:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c4989ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661eba expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179009.249914:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc903340100) 00010000:00010000:1.0:1788179009.249917:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788179009.249920:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc92e12c200, rc 0) 00000100:00100000:1.0:1788179009.249978:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:5597:x1875041450986624:12345-192.168.202.2@tcp:101: Request processed in 676us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179009.249984:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:2.0:1788179009.730508:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788179009.730718:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471980160:0@lo:13: 00000100:00100000:2.0:1788179009.730793:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179009.745229:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471980160 00000100:00100000:0.0:1788179009.745246:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471980160 00000100:00100000:0.0:1788179009.745329:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788179009.745339:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471980160:12345-0@lo:13: 00002000:00000024:0.0:1788179009.745369:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788179009.745453:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471980160:12345-0@lo:13: Request processed in 116us (14659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179009.745478:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788179009.745700:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8d5f80 x1875041471980160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179009.745725:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471980160:0@lo:13: 00010000:00010000:2.0:1788179009.792146:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179010.820531:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788179011.557972:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179011.558161:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450986752 00000100:00100000:1.0:1788179011.558171:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450986752 00000100:00100000:1.0:1788179011.558258:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:1.0:1788179011.558267:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:5649:x1875041450986752:12345-192.168.202.2@tcp:41: 00000004:00000024:1.0:1788179011.558317:0:5796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788179011.558398:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:5649:x1875041450986752:12345-192.168.202.2@tcp:41: Request processed in 131us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179011.558407:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00080000:2.0:1788179011.558583:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788179011.573515:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179011.573763:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450986880 00000100:00100000:0.0:1788179011.573775:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450986880 00000100:00100000:0.0:1788179011.573903:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:0.0:1788179011.573915:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:5649:x1875041450986880:12345-192.168.202.2@tcp:13: 00002000:00000024:0.0:1788179011.573963:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788179011.574061:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:5649:x1875041450986880:12345-192.168.202.2@tcp:13: Request processed in 149us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179011.574069:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00080000:2.0:1788179011.574227:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788179011.579592:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179011.579759:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450987008 00000100:00100000:2.0:1788179011.579772:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450987008 00000100:00100000:2.0:1788179011.579901:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:2.0:1788179011.579913:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:5649:x1875041450987008:12345-192.168.202.2@tcp:13: 00002000:00000024:2.0:1788179011.579962:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179011.580045:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:5649:x1875041450987008:12345-192.168.202.2@tcp:13: Request processed in 135us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179011.580054:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00080000:1.0:1788179011.580799:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788179011.840476:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788179011.883350:0:6618:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 334bb25c-6762-4beb-8a84-3a838cbc7e80 00000001:00100000:2.0:1788179012.429532:0:7496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 334bb25c-6762-4beb-8a84-3a838cbc7e80 00010000:00010000:2.0:1788179012.865243:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788179013.314751:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471980288:0@lo:13: 00000100:00100000:2.0:1788179013.314843:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179013.315391:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471980288 00000100:00100000:0.0:1788179013.315402:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471980288 00000100:00100000:0.0:1788179013.315475:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788179013.315486:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471980288:12345-0@lo:13: 00002000:00000024:0.0:1788179013.315538:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788179013.315596:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471980288:12345-0@lo:13: Request processed in 111us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179013.315603:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788179013.315659:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc9358fa680 x1875041471980288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179013.315677:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471980288:0@lo:13: 00000100:00080000:3.0:1788179013.315794:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1788179013.397372:0:5818:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 334bb25c-6762-4beb-8a84-3a838cbc7e80 00010000:00010000:2.0:1788179013.892759:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179014.284968:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179014.285013:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179014.285041:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179014.285097:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179014.285127:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450987264 00000100:00100000:3.0:1788179014.285138:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450987264 00000100:00100000:3.0:1788179014.285200:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:3.0:1788179014.285210:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2356:x1875041450987264:12345-192.168.202.2@tcp:400: 00000100:00100000:3.0:1788179014.285280:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2356:x1875041450987264:12345-192.168.202.2@tcp:400: Request processed in 71us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179014.285287:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:3.0:1788179014.285307:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450987392 00000100:00100000:3.0:1788179014.285310:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450987392 00000100:00100000:3.0:1788179014.285331:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450987520 00000100:00100000:3.0:1788179014.285334:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450987520 00000100:00100000:3.0:1788179014.285351:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:3.0:1788179014.285357:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2356:x1875041450987392:12345-192.168.202.2@tcp:400: 00000100:00100000:3.0:1788179014.285381:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2356:x1875041450987392:12345-192.168.202.2@tcp:400: Request processed in 24us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179014.285387:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:3.0:1788179014.285397:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:3.0:1788179014.285419:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2356:x1875041450987520:12345-192.168.202.2@tcp:400: 00000100:00100000:3.0:1788179014.285445:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2356:x1875041450987520:12345-192.168.202.2@tcp:400: Request processed in 27us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179014.285452:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00080000:3.0:1788179014.285468:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788179014.285472:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788179014.285474:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788179014.287039:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450987136 00000100:00100000:1.0:1788179014.287052:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450987136 00000100:00100000:1.0:1788179014.287108:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 129 00000100:00100000:1.0:1788179014.287117:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:2356:x1875041450987136:12345-192.168.202.2@tcp:400: 00000100:00100000:1.0:1788179014.287184:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:2356:x1875041450987136:12345-192.168.202.2@tcp:400: Request processed in 67us (2225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179014.287191:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 129 00000100:00100000:2.0:1788179014.344639:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041471980544:0@lo:400: 00000100:00100000:2.0:1788179014.344712:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179014.344765:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471981056:0@lo:400: 00000100:00100000:2.0:1788179014.344792:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179014.344824:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788179014.344830:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875041471980672:0@lo:400: 00000100:00100000:3.0:1788179014.344988:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471980800:0@lo:400: 00000100:00100000:1.0:1788179014.345055:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041471980416:0@lo:400: 00000100:00100000:3.0:1788179014.349236:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179014.349327:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471981056 00000100:00100000:3.0:1788179014.349336:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471981056 00000100:00100000:3.0:1788179014.349392:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471980800 00000100:00100000:3.0:1788179014.349396:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471980800 00000100:00100000:3.0:1788179014.349423:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788179014.349432:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471981056:12345-0@lo:400: 00000100:00100000:3.0:1788179014.349492:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471981056:12345-0@lo:400: Request processed in 62us (4699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179014.349499:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788179014.349514:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788179014.349520:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471980800:12345-0@lo:400: 00000100:00100000:3.0:1788179014.349555:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471980800:12345-0@lo:400: Request processed in 35us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179014.349561:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788179014.349581:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788179014.349617:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc910b9f480 x1875041471980800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179014.349631:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471980800:0@lo:400: 00000100:00100000:1.0:1788179014.349760:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179014.349806:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875041471980928:0@lo:400: 00000100:00100000:1.0:1788179014.349841:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179014.353817:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471980544 00000100:00100000:1.0:1788179014.353832:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471980544 00000100:00100000:1.0:1788179014.353915:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471980928 00000100:00100000:1.0:1788179014.353920:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471980928 00000100:00100000:1.0:1788179014.353957:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788179014.353967:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041471980544:12345-0@lo:400: 00000100:00100000:1.0:1788179014.354070:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041471980544:12345-0@lo:400: Request processed in 94us (9347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179014.354077:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788179014.354111:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788179014.354117:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875041471980928:12345-0@lo:400: 00000100:00100000:1.0:1788179014.354154:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875041471980928:12345-0@lo:400: Request processed in 37us (4311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179014.354159:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788179014.354181:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788179014.354218:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875041471980928:0@lo:400: 00000100:00100000:3.0:1788179014.354388:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471980416 00000100:00100000:3.0:1788179014.354393:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471980416 00000100:00100000:3.0:1788179014.354417:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788179014.354424:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:3306:x1875041471980416:12345-0@lo:400: 00000100:00100000:3.0:1788179014.354460:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:3306:x1875041471980416:12345-0@lo:400: Request processed in 37us (4701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179014.354466:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788179014.354594:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179014.354627:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041471980544:0@lo:400: 00010000:00080000:2.0:1788179014.354643:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc910b9fb80 x1875041471981056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179014.354653:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471981056:0@lo:400: 00000100:00100000:1.0:1788179014.357436:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041471980416:0@lo:400: 00000100:00100000:1.0:1788179014.357482:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471980672 00000100:00100000:1.0:1788179014.357489:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471980672 00000100:00100000:1.0:1788179014.357561:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788179014.357571:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875041471980672:12345-0@lo:400: 00000100:00100000:1.0:1788179014.357658:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875041471980672:12345-0@lo:400: Request processed in 88us (3064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179014.357665:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788179014.357701:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875041471980672:0@lo:400: 00000100:00080000:3.0:1788179014.357762:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1788179014.782772:0:8154:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1788179014.849234:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788179014.852243:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471981184:0@lo:13: 00000100:00100000:2.0:1788179014.852336:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179014.852459:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471981184 00000100:00100000:3.0:1788179014.852468:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471981184 00000100:00100000:3.0:1788179014.852524:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788179014.852533:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471981184:12345-0@lo:13: 00002000:00000024:3.0:1788179014.852572:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788179014.852633:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471981184:12345-0@lo:13: Request processed in 101us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179014.852641:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788179014.852714:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93abb8380 x1875041471981184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179030 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788179014.852733:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471981184:0@lo:13: 00010000:00010000:1.0:1788179014.913653:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179015.936472:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179016.960195:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179017.984344:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788179018.433542:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788179018.433569:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041471981312:0@lo:13: 00000100:00100000:2.0:1788179018.433638:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179018.434335:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471981312 00000100:00100000:0.0:1788179018.435491:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471981312 00000100:00100000:0.0:1788179018.435559:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788179018.435569:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041471981312:12345-0@lo:13: 00002000:00000024:0.0:1788179018.435605:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788179018.435673:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041471981312:12345-0@lo:13: Request processed in 106us (2035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179018.435680:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788179018.435815:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8d7800 x1875041471981312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179018.435837:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041471981312:0@lo:13: 00000100:00080000:3.0:1788179018.436060:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1788179018.733486:0:8302:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff7c347f90 20000000:00000080:0.0:1788179018.733511:0:8302:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bc93f911000 uarg=0000000000000000 20000000:01000000:0.0:1788179018.733571:0:8302:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788179018.733574:0:8302:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788179018.733577:0:8302:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788179018.733582:0:8302:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788179018.733587:0:8302:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788179018.733603:0:8302:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788179018.733605:0:8302:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788179018.733803:0:8302:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788179018.733806:0:8302:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788179018.734710:0:8303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1788179018.735467:0:8302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1788179018.735525:0:8302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1788179018.735562:0:8302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1788179018.735576:0:8302:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788179018.735579:0:8302:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788179018.740528:0:8304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1788179018.744819:0:8302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1788179018.747371:0:8302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1788179018.747489:0:8302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1788179018.747511:0:8302:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788179018.747515:0:8302:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788179018.754614:0:8305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1788179018.755650:0:8302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1788179018.755719:0:8302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1788179018.755770:0:8302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1788179018.755788:0:8302:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788179018.755791:0:8302:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788179018.764426:0:8306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788179018.765646:0:8302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1788179018.765711:0:8302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1788179018.765749:0:8302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1788179018.765767:0:8302:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788179018.765789:0:8302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bc9137b5000/0xaa4c98508c4989f4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.765807:0:8302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c4988f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c4988ea expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.765815:0:8302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc9137b4c00/0xaa4c98508c49891b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498914 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.765830:0:8302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc91317f400/0xaa4c98508c498945 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c49893e expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.765837:0:8302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc91317f200/0xaa4c98508c498953 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c49894c expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.765844:0:8302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc91317e400/0xaa4c98508c498961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c49895a expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.765888:0:8302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc942173e00/0xaa4c98508c49897d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498976 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.765896:0:8302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc900030e00/0xaa4c98508c4989a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c4989a0 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.765904:0:8302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc942172400/0xaa4c98508c4989b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e58 expref: 9 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.765912:0:8302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc900030400/0xaa4c98508c4989bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e5f expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.765919:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bc9137b5000/0xaa4c98508c4989f4 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.766034:0:8302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc900030400/0xaa4c98508c4989bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e5f expref: 9 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.766049:0:8302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bc900030400/0xaa4c98508c4989bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e5f expref: 9 pid: 5791 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179018.766074:0:8302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358f8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8302:1875041471981440:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788179018.769689:0:8302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc942172400/0xaa4c98508c4989b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e58 expref: 9 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.769710:0:8302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bc942172400/0xaa4c98508c4989b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e58 expref: 9 pid: 5789 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179018.769725:0:8302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358f9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8302:1875041471981568:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788179018.769795:0:8302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc900030e00/0xaa4c98508c4989a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c4989a0 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.769803:0:8302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bc900030e00/0xaa4c98508c4989a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c4989a0 expref: 18 pid: 5789 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179018.769811:0:8302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358f8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8302:1875041471981696:0@lo:104: 00000100:00100000:3.0:1788179018.769845:0:8302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788179018.769904:0:8302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc942173e00/0xaa4c98508c49897d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c498976 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.769912:0:8302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bc942173e00/0xaa4c98508c49897d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c498976 expref: 18 pid: 5791 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179018.769920:0:8302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358f9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8302:1875041471981824:0@lo:104: 00000100:00100000:3.0:1788179018.769955:0:8302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788179018.769977:0:8302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc91317e400/0xaa4c98508c498961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c49895a expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.769985:0:8302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bc91317e400/0xaa4c98508c498961 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c49895a expref: 18 pid: 5789 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179018.770007:0:8302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358fbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8302:1875041471981952:0@lo:104: 00010000:00010000:3.0:1788179018.770046:0:8302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc91317f200/0xaa4c98508c498953 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c49894c expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.770054:0:8302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bc91317f200/0xaa4c98508c498953 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c49894c expref: 18 pid: 5790 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179018.770061:0:8302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358fb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8302:1875041471982080:0@lo:104: 00010000:00010000:3.0:1788179018.770091:0:8302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc91317f400/0xaa4c98508c498945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c49893e expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.770099:0:8302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bc91317f400/0xaa4c98508c498945 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c49893e expref: 18 pid: 5790 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179018.770107:0:8302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358f9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8302:1875041471982208:0@lo:104: 00010000:00010000:3.0:1788179018.770139:0:8302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc9137b4c00/0xaa4c98508c49891b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c498914 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.770148:0:8302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bc9137b4c00/0xaa4c98508c49891b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c498914 expref: 18 pid: 5789 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179018.770282:0:5780:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788179018.770304:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179018.770315:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179018.770324:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179018.770332:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471981696 00000100:00100000:0.0:1788179018.770339:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471981696 00000100:00100000:0.0:1788179018.770385:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471981824 00000100:00100000:0.0:1788179018.770389:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471981824 00000100:00100000:0.0:1788179018.770412:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471981952 00000100:00100000:0.0:1788179018.770416:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471981952 00000100:00100000:3.0:1788179018.770418:0:8302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358fa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8302:1875041471982336:0@lo:104: 00000100:00100000:0.0:1788179018.770429:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471982080 00000100:00100000:0.0:1788179018.770433:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471982080 00000100:00100000:0.0:1788179018.770447:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471982208 00000100:00100000:0.0:1788179018.770449:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471982208 00000100:00100000:3.0:1788179018.770464:0:8302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179018.770467:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788179018.770478:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+7:8302:x1875041471981696:12345-0@lo:104: 00010000:00010000:0.0:1788179018.770491:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4200/0xaa4c98508c4989a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c4989a7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.770493:0:8302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c4988f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c4988ea expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.770513:0:8302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c4988f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c4988ea expref: 18 pid: 5789 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179018.770534:0:8302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f6ddc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8302:1875041471982464:0@lo:104: 00010000:00010000:0.0:1788179018.770554:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788179018.770562:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+7:8302:x1875041471981696:12345-0@lo:104: Request processed in 85us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179018.770567:0:8302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179018.770576:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788179018.770583:0:8302:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc8013bfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788179018.770597:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471982336 00000100:00100000:0.0:1788179018.770601:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471982336 00000100:00100000:3.0:1788179018.770606:0:8302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358f8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8302:1875041471981696:0@lo:104: 00000100:00100000:0.0:1788179018.770615:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471982464 00000100:00100000:0.0:1788179018.770619:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471982464 00000100:00100000:0.0:1788179018.770631:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788179018.770636:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e129450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+8:8302:x1875041471981824:12345-0@lo:104: 00010000:00010000:0.0:1788179018.770643:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc942172e00/0xaa4c98508c498976 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c49897d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.770684:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788179018.770690:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e129450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+8:8302:x1875041471981824:12345-0@lo:104: Request processed in 54us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179018.770696:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788179018.770717:0:8302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358f9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8302:1875041471981824:0@lo:104: 00000100:00100000:0.0:1788179018.770740:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788179018.770746:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+7:8302:x1875041471981952:12345-0@lo:104: 00010000:00010000:0.0:1788179018.770753:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc91317fa00/0xaa4c98508c49895a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498961 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.770790:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788179018.770795:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+7:8302:x1875041471981952:12345-0@lo:104: Request processed in 50us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179018.770800:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788179018.770811:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788179018.770816:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+6:8302:x1875041471982080:12345-0@lo:104: 00010000:00010000:0.0:1788179018.770822:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c49894c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498953 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179018.770877:0:8302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358fbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8302:1875041471981952:0@lo:104: 00010000:00010000:0.0:1788179018.770879:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788179018.770889:0:8302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358fb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8302:1875041471982080:0@lo:104: 00000100:00100000:0.0:1788179018.770899:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+6:8302:x1875041471982080:12345-0@lo:104: Request processed in 82us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179018.770905:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788179018.770918:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788179018.770923:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+5:8302:x1875041471982208:12345-0@lo:104: 00010000:00010000:0.0:1788179018.770929:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c49893e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498945 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.770962:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788179018.770967:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+5:8302:x1875041471982208:12345-0@lo:104: Request processed in 45us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179018.770972:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788179018.770992:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788179018.770997:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+4:8302:x1875041471982336:12345-0@lo:104: 00010000:00010000:0.0:1788179018.771003:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c49891b expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771042:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788179018.771047:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+4:8302:x1875041471982336:12345-0@lo:104: Request processed in 51us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179018.771053:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788179018.771068:0:8302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358f9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8302:1875041471982208:0@lo:104: 00000100:00100000:0.0:1788179018.771069:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788179018.771079:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+3:8302:x1875041471982464:12345-0@lo:104: 00000100:00100000:3.0:1788179018.771083:0:8302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358fa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8302:1875041471982336:0@lo:104: 00010000:00010000:0.0:1788179018.771088:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5600/0xaa4c98508c4988ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c4988f1 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771129:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788179018.771134:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+3:8302:x1875041471982464:12345-0@lo:104: Request processed in 58us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179018.771140:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788179018.771156:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788179018.771162:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4200/0xaa4c98508c4989a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c4989a7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771169:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4200 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1788179018.771173:0:6606:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4200/0xaa4c98508c4989a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c4989a7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771182:0:6606:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4200/0xaa4c98508c4989a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c4989a7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788179018.771199:0:6606:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4200/0xaa4c98508c4989a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c4989a7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788179018.771205:0:6606:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788179018.771235:0:6606:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4200/0xaa4c98508c4989a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c4989a7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771242:0:6606:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788179018.771255:0:8302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f6ddc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8302:1875041471982464:0@lo:104: 00010000:00010000:0.0:1788179018.771264:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4200/0xaa4c98508c4989a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c4989a7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771273:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4200/0xaa4c98508c4989a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c4989a7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771285:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788179018.771288:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc942172e00/0xaa4c98508c498976 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c49897d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771293:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc942172e00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1788179018.771295:0:6606:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc942172e00/0xaa4c98508c498976 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c49897d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771301:0:6606:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc942172e00/0xaa4c98508c498976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c49897d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788179018.771307:0:6606:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc942172e00/0xaa4c98508c498976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c49897d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788179018.771312:0:6606:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788179018.771331:0:6606:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc942172e00/0xaa4c98508c498976 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c49897d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771337:0:6606:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788179018.771356:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc942172e00/0xaa4c98508c498976 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c49897d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771362:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc942172e00/0xaa4c98508c498976 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c49897d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771374:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788179018.771377:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc91317fa00/0xaa4c98508c49895a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498961 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771382:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317fa00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1788179018.771385:0:6606:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc91317fa00/0xaa4c98508c49895a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c498961 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179018.771386:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041471982720:0@lo:103: 00010000:00010000:0.0:1788179018.771400:0:6606:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc91317fa00/0xaa4c98508c49895a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c498961 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788179018.771406:0:6606:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc91317fa00/0xaa4c98508c49895a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c498961 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788179018.771412:0:6606:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788179018.771422:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788179018.771427:0:6606:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc91317fa00/0xaa4c98508c49895a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498961 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771434:0:6606:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788179018.771441:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc91317fa00/0xaa4c98508c49895a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498961 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179018.771458:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1788179018.771458:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc91317fa00/0xaa4c98508c49895a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498961 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179018.771467:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041471982848:0@lo:103: 00010000:00010000:0.0:1788179018.771472:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788179018.771477:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c49894c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498953 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771483:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317ee00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1788179018.771487:0:6606:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c49894c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c498953 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179018.771492:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788179018.771500:0:6606:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c49894c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c498953 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788179018.771507:0:6606:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c49894c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c498953 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788179018.771513:0:6606:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788179018.771528:0:6606:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c49894c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498953 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771534:0:6606:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788179018.771540:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c49894c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498953 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771546:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc91317ee00/0xaa4c98508c49894c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498953 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771554:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788179018.771562:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c49893e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498945 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771568:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317e200 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1788179018.771571:0:6606:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c49893e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c498945 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771577:0:6606:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c49893e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c498945 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788179018.771584:0:6606:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c49893e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c498945 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788179018.771589:0:6606:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788179018.771602:0:6606:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c49893e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498945 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771608:0:6606:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788179018.771612:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c49893e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498945 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771619:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c49893e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498945 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771627:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788179018.771630:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c49891b expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771635:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc900031200 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1788179018.771638:0:6606:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c49891b expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771654:0:6606:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c49891b expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788179018.771661:0:6606:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c49891b expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788179018.771665:0:6606:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788179018.771676:0:6606:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498914 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c49891b expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771682:0:6606:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788179018.771700:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498914 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c49891b expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771706:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498914 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c49891b expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771716:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788179018.771719:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5600/0xaa4c98508c4988ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c4988f1 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771724:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5600 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1788179018.771727:0:6606:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5600/0xaa4c98508c4988ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c4988f1 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771734:0:6606:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5600/0xaa4c98508c4988ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c4988f1 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788179018.771739:0:6606:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5600/0xaa4c98508c4988ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c4988f1 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788179018.771751:0:6606:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788179018.771764:0:6606:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5600/0xaa4c98508c4988ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c4988f1 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771770:0:6606:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788179018.771775:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5600/0xaa4c98508c4988ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c4988f1 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771781:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5600/0xaa4c98508c4988ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c4988f1 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.771794:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179018.771796:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179018.771798:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179018.771806:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179018.771814:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179018.771832:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041471982976:0@lo:103: 00000100:00100000:0.0:1788179018.771884:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179018.771908:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788179018.771913:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041471982592:0@lo:103: 00000100:00100000:0.0:1788179018.771931:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179018.771939:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041471983104:0@lo:103: 00000100:00100000:0.0:1788179018.771952:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179018.771967:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471983360:0@lo:103: 00000100:00100000:0.0:1788179018.771985:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179018.771994:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788179018.771998:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471983232:0@lo:103: 00000100:00100000:0.0:1788179018.772039:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179018.772059:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471982720 00000100:00100000:0.0:1788179018.772065:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471982720 00010000:00010000:0.0:1788179018.772087:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc942173e00/0xaa4c98508c49897d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c498976 expref: 19 pid: 5791 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179018.772102:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471982848 00000100:00100000:0.0:1788179018.772104:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471982848 00010000:00010000:0.0:1788179018.772114:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc91317e400/0xaa4c98508c498961 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c49895a expref: 20 pid: 5789 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179018.772123:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471982976 00000100:00100000:0.0:1788179018.772126:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471982976 00010000:00010000:0.0:1788179018.772135:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc91317f200/0xaa4c98508c498953 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c49894c expref: 21 pid: 5790 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179018.772145:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471982592 00000100:00100000:0.0:1788179018.772147:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471982592 00010000:00010000:0.0:1788179018.772156:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc900030e00/0xaa4c98508c4989a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c4989a0 expref: 22 pid: 5789 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179018.772164:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471983104 00000100:00100000:0.0:1788179018.772167:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471983104 00010000:00010000:0.0:1788179018.772175:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc91317f400/0xaa4c98508c498945 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c49893e expref: 23 pid: 5790 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179018.772183:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471983360 00000100:00100000:0.0:1788179018.772185:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471983360 00010000:00010000:0.0:1788179018.772197:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c4988f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c4988ea expref: 24 pid: 5789 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179018.772206:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471983232 00000100:00100000:0.0:1788179018.772214:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471983232 00010000:00010000:0.0:1788179018.772225:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc9137b4c00/0xaa4c98508c49891b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c498914 expref: 25 pid: 5789 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179018.772241:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788179018.772249:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+25:3307:x1875041471982720:12345-0@lo:103: 00010000:00010000:0.0:1788179018.772262:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179018.772268:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc942173e00/0xaa4c98508c49897d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c498976 expref: 25 pid: 5791 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.772277:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc942173e00/0xaa4c98508c49897d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c498976 expref: 25 pid: 5791 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.772292:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc942173e00/0xaa4c98508c49897d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c498976 expref: 25 pid: 5791 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.772307:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179018.772348:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+24:3307:x1875041471982720:12345-0@lo:103: Request processed in 100us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179018.772355:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788179018.772373:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788179018.772379:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+23:3307:x1875041471982848:12345-0@lo:103: 00010000:00010000:0.0:1788179018.772387:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179018.772391:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc91317e400/0xaa4c98508c498961 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c49895a expref: 23 pid: 5789 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.772399:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc91317e400/0xaa4c98508c498961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c49895a expref: 23 pid: 5789 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.772409:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc91317e400/0xaa4c98508c498961 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c49895a expref: 23 pid: 5789 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.772425:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179018.772448:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+22:3307:x1875041471982848:12345-0@lo:103: Request processed in 69us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179018.772454:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788179018.772467:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788179018.772473:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+21:3305:x1875041471982976:12345-0@lo:103: 00010000:00010000:0.0:1788179018.772479:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179018.772483:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc91317f200/0xaa4c98508c498953 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c49894c expref: 21 pid: 5790 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.772490:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc91317f200/0xaa4c98508c498953 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c49894c expref: 21 pid: 5790 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.772500:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc91317f200/0xaa4c98508c498953 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c49894c expref: 21 pid: 5790 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.772509:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179018.772532:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+20:3305:x1875041471982976:12345-0@lo:103: Request processed in 60us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179018.772538:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788179018.772549:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788179018.772555:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+19:3305:x1875041471982592:12345-0@lo:103: 00010000:00010000:0.0:1788179018.772562:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179018.772565:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc900030e00/0xaa4c98508c4989a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c4989a0 expref: 19 pid: 5789 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.772573:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc900030e00/0xaa4c98508c4989a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c4989a0 expref: 19 pid: 5789 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.772589:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc900030e00/0xaa4c98508c4989a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c4989a0 expref: 19 pid: 5789 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.772598:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179018.772620:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+18:3305:x1875041471982592:12345-0@lo:103: Request processed in 66us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179018.772626:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788179018.772639:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788179018.772645:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+17:3305:x1875041471983104:12345-0@lo:103: 00010000:00010000:0.0:1788179018.772651:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179018.772656:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc91317f400/0xaa4c98508c498945 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c49893e expref: 17 pid: 5790 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.772663:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc91317f400/0xaa4c98508c498945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c49893e expref: 17 pid: 5790 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.772672:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc91317f400/0xaa4c98508c498945 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c49893e expref: 17 pid: 5790 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.772680:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179018.772699:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+16:3305:x1875041471983104:12345-0@lo:103: Request processed in 55us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179018.772704:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788179018.772715:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788179018.772720:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+15:3308:x1875041471983360:12345-0@lo:103: 00010000:00010000:0.0:1788179018.772729:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179018.772733:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c4988f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c4988ea expref: 15 pid: 5789 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.772747:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c4988f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c4988ea expref: 15 pid: 5789 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179018.772757:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041471982848:0@lo:103: 00010000:00010000:0.0:1788179018.772760:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c4988f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c4988ea expref: 15 pid: 5789 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179018.772772:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041471982720:0@lo:103: 00010000:00010000:0.0:1788179018.772772:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179018.772807:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+14:3308:x1875041471983360:12345-0@lo:103: Request processed in 85us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179018.772813:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788179018.772828:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788179018.772834:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc905f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+13:3308:x1875041471983232:12345-0@lo:103: 00010000:00010000:0.0:1788179018.772841:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179018.772845:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc9137b4c00/0xaa4c98508c49891b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c498914 expref: 13 pid: 5789 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.772888:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc9137b4c00/0xaa4c98508c49891b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c498914 expref: 13 pid: 5789 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.772899:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc9137b4c00/0xaa4c98508c49891b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c498914 expref: 13 pid: 5789 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179018.772907:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179018.772930:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc905f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+12:3308:x1875041471983232:12345-0@lo:103: Request processed in 96us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179018.772935:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788179018.772990:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471983232:0@lo:103: 00010000:00010000:3.0:1788179018.772992:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179018.773001:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471983360:0@lo:103: 00000100:00100000:1.0:1788179018.774202:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041471982592:0@lo:103: 00000100:00100000:1.0:1788179018.774218:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041471983104:0@lo:103: 00000100:00100000:1.0:1788179018.774228:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041471982976:0@lo:103: 00000100:00100000:1.0:1788179018.777997:0:8302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358f8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8302:1875041471981440:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788179018.778416:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179018.778819:0:8302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358f9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8302:1875041471981568:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788179018.778883:0:8302:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bc9137b5000/0xaa4c98508c4989f4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179018.779558:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450987648 00000100:00100000:2.0:1788179018.779567:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450987648 00010000:00010000:2.0:1788179018.779604:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc900030400/0xaa4c98508c4989bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e5f expref: 10 pid: 5791 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179018.779645:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:2.0:1788179018.779655:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:2356:x1875041450987648:12345-192.168.202.2@tcp:103: 00010000:00010000:2.0:1788179018.779669:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179018.779674:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc900030400/0xaa4c98508c4989bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e5f expref: 10 pid: 5791 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179018.779686:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc900030400/0xaa4c98508c4989bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e5f expref: 10 pid: 5791 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179018.779705:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc900030400/0xaa4c98508c4989bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e5f expref: 10 pid: 5791 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179018.779730:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788179018.779790:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+9:2356:x1875041450987648:12345-192.168.202.2@tcp:103: Request processed in 136us (1375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179018.779798:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:3.0:1788179018.793826:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179018.793887:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450987776 00000100:00100000:3.0:1788179018.793898:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450987776 00010000:00010000:3.0:1788179018.794577:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc942172400/0xaa4c98508c4989b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e58 expref: 9 pid: 5789 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179018.795759:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:3.0:1788179018.795776:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+9:2356:x1875041450987776:12345-192.168.202.2@tcp:103: 00010000:00010000:3.0:1788179018.795795:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179018.795802:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc942172400/0xaa4c98508c4989b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e58 expref: 9 pid: 5789 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.795818:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc942172400/0xaa4c98508c4989b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e58 expref: 9 pid: 5789 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.795837:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc942172400/0xaa4c98508c4989b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e58 expref: 9 pid: 5789 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.795881:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bc9137b5000/0xaa4c98508c4989f4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.795891:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9137b5000/0xaa4c98508c4989f4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.795907:0:5783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bc9137b5000/0xaa4c98508c4989f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.795913:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bc9137b5000/0xaa4c98508c4989f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.795920:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bc9137b5000/0xaa4c98508c4989f4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.797431:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bc9137b5000/0xaa4c98508c4989f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.797465:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5000 already unused, calling callback (ffffffffc1644220) 00010000:00010000:3.0:1788179018.797472:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bc9137b5000/0xaa4c98508c4989f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.797481:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bc9137b5000/0xaa4c98508c4989f4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.797502:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bc9137b5000/0xaa4c98508c4989f4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179018.797517:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179018.797580:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+8:2356:x1875041450987776:12345-192.168.202.2@tcp:103: Request processed in 1808us (3762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179018.797591:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00010000:00010000:2.0:1788179018.797800:0:8302:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bc9137b5000/0xaa4c98508c4989f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179018.797808:0:8302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bc9137b5000/0xaa4c98508c4989f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179018.797815:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc9137b5000/0xaa4c98508c4989f4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179019.011830:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179019.402569:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179019.402617:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179019.402651:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179019.402688:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179019.402905:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450988288 00000100:00100000:3.0:1788179019.402916:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450988288 00000100:00100000:3.0:1788179019.402982:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450988160 00000100:00100000:3.0:1788179019.402986:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450988160 00000100:00100000:3.0:1788179019.403026:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:3.0:1788179019.403046:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2355:x1875041450988288:12345-192.168.202.2@tcp:400: 00000100:00100000:2.0:1788179019.403116:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450987904 00000100:00100000:2.0:1788179019.403120:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450987904 00000100:00100000:3.0:1788179019.403123:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2355:x1875041450988288:12345-192.168.202.2@tcp:400: Request processed in 80us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179019.403131:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:3.0:1788179019.403147:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:3.0:1788179019.403154:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2355:x1875041450988160:12345-192.168.202.2@tcp:400: 00000100:00100000:2.0:1788179019.403159:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 131 00000100:00100000:2.0:1788179019.403166:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+8:2355:x1875041450987904:12345-192.168.202.2@tcp:400: 00000100:00100000:3.0:1788179019.403177:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2355:x1875041450988160:12345-192.168.202.2@tcp:400: Request processed in 24us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179019.403199:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+8:2355:x1875041450987904:12345-192.168.202.2@tcp:400: Request processed in 34us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179019.403200:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:2.0:1788179019.403205:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 131 00000100:00080000:0.0:1788179019.403573:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788179019.403578:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788179019.404624:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450988032 00000100:00100000:1.0:1788179019.404635:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450988032 00000100:00100000:1.0:1788179019.404709:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:1.0:1788179019.404719:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2355:x1875041450988032:12345-192.168.202.2@tcp:400: 00000100:00100000:1.0:1788179019.404797:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2355:x1875041450988032:12345-192.168.202.2@tcp:400: Request processed in 80us (2241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179019.404804:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00080000:0.0:1788179019.405583:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788179019.460327:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788179019.460367:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875041471983744:0@lo:400: 00000100:00100000:0.0:1788179019.460444:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179019.460538:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041471983872:0@lo:400: 00000100:00100000:0.0:1788179019.460566:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179019.460816:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875041471983616:0@lo:400: 00000100:00100000:2.0:1788179019.460886:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179019.460907:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041471984128:0@lo:400: 00000100:00100000:2.0:1788179019.460943:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179019.460973:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788179019.460979:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041471983488:0@lo:400: 00000100:00100000:2.0:1788179019.461040:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179019.461064:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875041471984000:0@lo:400: 00000100:00100000:2.0:1788179019.461086:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179019.461117:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471983488 00000100:00100000:2.0:1788179019.461125:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471983488 00000100:00100000:2.0:1788179019.461172:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788179019.461181:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+12:3306:x1875041471983488:12345-0@lo:400: 00000100:00100000:2.0:1788179019.461236:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+12:3306:x1875041471983488:12345-0@lo:400: Request processed in 55us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179019.461243:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788179019.461278:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471983872 00000100:00100000:2.0:1788179019.461282:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471983872 00000100:00100000:2.0:1788179019.461304:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471984128 00000100:00100000:2.0:1788179019.461307:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471984128 00000100:00100000:2.0:1788179019.461335:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788179019.461528:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041471983872:12345-0@lo:400: 00000100:00100000:2.0:1788179019.461574:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041471983872:12345-0@lo:400: Request processed in 233us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179019.461581:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788179019.461595:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788179019.461602:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041471984128:12345-0@lo:400: 00000100:00100000:2.0:1788179019.461628:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041471984128:12345-0@lo:400: Request processed in 27us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179019.461634:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788179019.461648:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788179019.461681:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8d6680 x1875041471983872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179019.461709:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041471983872:0@lo:400: 00000100:00100000:2.0:1788179019.461740:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471983744 00000100:00100000:2.0:1788179019.461744:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471983744 00000100:00100000:2.0:1788179019.461773:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471983616 00000100:00100000:2.0:1788179019.461776:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471983616 00000100:00100000:2.0:1788179019.461786:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471984000 00000100:00100000:2.0:1788179019.461788:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471984000 00000100:00100000:2.0:1788179019.461801:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788179019.461809:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875041471983744:12345-0@lo:400: 00000100:00100000:2.0:1788179019.461845:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875041471983744:12345-0@lo:400: Request processed in 37us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179019.462543:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788179019.462556:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875041471983616:12345-0@lo:400: 00000100:00100000:3.0:1788179019.462599:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875041471983616:12345-0@lo:400: Request processed in 47us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179019.462606:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788179019.462621:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788179019.462627:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875041471984000:12345-0@lo:400: 00000100:00100000:3.0:1788179019.462656:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875041471984000:12345-0@lo:400: Request processed in 30us (1569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179019.462662:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788179019.462701:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788179019.462726:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041471983488:0@lo:400: 00000100:00100000:3.0:1788179019.462744:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875041471984000:0@lo:400: 00000100:00100000:3.0:1788179019.462756:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875041471983616:0@lo:400: 00010000:00080000:3.0:1788179019.462768:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8d4000 x1875041471984128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179019.462778:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041471984128:0@lo:400: 00000100:00100000:3.0:1788179019.462823:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875041471983744:0@lo:400: 00000100:00100000:2.0:1788179019.463149:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788179019.912784:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179019.919525:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450988416 00000100:00100000:2.0:1788179019.919546:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450988416 00000100:00100000:2.0:1788179019.919764:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 133 00000100:00100000:2.0:1788179019.919776:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+8:5572:x1875041450988416:12345-192.168.202.2@tcp:101: 00010000:00010000:2.0:1788179019.919795:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179019.919817:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9136c4e00/0xaa4c98508c4989fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x34c7c42474661ec1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179019.919875:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9136c4e00/0xaa4c98508c4989fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ec1 expref: 9 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179019.919889:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9136c4e00/0xaa4c98508c4989fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ec1 expref: 9 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179019.919900:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c4e00, rc 0) 00000100:00100000:2.0:1788179019.920707:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+9:5572:x1875041450988416:12345-192.168.202.2@tcp:101: Request processed in 928us (7927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179019.920733:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 133 00000100:00100000:2.0:1788179019.929177:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179019.929289:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450988544 00000100:00100000:0.0:1788179019.929303:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450988544 00000100:00100000:0.0:1788179019.929385:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 134 00000100:00100000:0.0:1788179019.929402:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+9:5572:x1875041450988544:12345-192.168.202.2@tcp:501: 00000100:00100000:0.0:1788179019.929751:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+9:5572:x1875041450988544:12345-192.168.202.2@tcp:501: Request processed in 353us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179019.929759:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 134 00000100:00100000:3.0:1788179019.932269:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179019.932371:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450988672 00000100:00100000:2.0:1788179019.932381:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450988672 00000100:00100000:2.0:1788179019.932432:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 135 00000100:00100000:2.0:1788179019.932442:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+9:5572:x1875041450988672:12345-192.168.202.2@tcp:503: 00000100:00100000:2.0:1788179019.932711:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+9:5572:x1875041450988672:12345-192.168.202.2@tcp:503: Request processed in 269us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179019.932720:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 135 00000100:00100000:2.0:1788179019.942668:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179019.945564:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450988800 00000100:00100000:1.0:1788179019.946075:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450988800 00000100:00100000:1.0:1788179019.946202:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 136 00000100:00100000:1.0:1788179019.946215:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+9:6038:x1875041450988800:12345-192.168.202.2@tcp:502: 00000100:00100000:1.0:1788179019.946616:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+9:6038:x1875041450988800:12345-192.168.202.2@tcp:502: Request processed in 403us (3959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179019.946625:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 136 00000100:00100000:3.0:1788179019.960443:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179019.971044:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450988928 00000100:00100000:2.0:1788179019.971062:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450988928 00000100:00100000:2.0:1788179019.971134:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 137 00000100:00100000:2.0:1788179019.971145:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+9:6038:x1875041450988928:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788179019.971618:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+9:6038:x1875041450988928:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 473us (11184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179019.971628:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 137 00000100:00100000:3.0:1788179019.974591:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179019.974786:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450989056 00000100:00100000:1.0:1788179019.974796:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450989056 00000100:00100000:1.0:1788179019.974891:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 138 00000100:00100000:1.0:1788179019.974901:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+9:5572:x1875041450989056:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788179019.974929:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179019.974948:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc92e12d400/0xaa4c98508c498a02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x34c7c42474661ec8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179019.974980:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc92e12d400/0xaa4c98508c498a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ec8 expref: 10 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179019.974991:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc92e12d400/0xaa4c98508c498a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ec8 expref: 10 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179019.975001:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc92e12d400, rc 0) 00000100:00100000:1.0:1788179019.975062:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:5572:x1875041450989056:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 Request processed in 163us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179019.975070:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 138 00000100:00100000:3.0:1788179019.977370:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179019.977519:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450989184 00000100:00100000:1.0:1788179019.977527:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450989184 00000100:00100000:1.0:1788179019.977588:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 139 00000100:00100000:1.0:1788179019.977599:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:5572:x1875041450989184:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788179019.977875:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:5572:x1875041450989184:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 Request processed in 250us (486us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788179019.977884:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 139 00000100:00100000:3.0:1788179019.979954:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788179019.979996:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041471984256:0@lo:13: 00000100:00100000:3.0:1788179019.980084:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179019.980989:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471984256 00000100:00100000:2.0:1788179019.981000:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471984256 00000100:00100000:2.0:1788179019.981064:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788179019.981074:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041471984256:12345-0@lo:13: 00002000:00000024:2.0:1788179019.981140:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179019.981206:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041471984256:12345-0@lo:13: Request processed in 134us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179019.981214:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788179019.981282:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8ed880 x1875041471984256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179035 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179019.981303:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041471984256:0@lo:13: 00010000:00010000:0.0:1788179020.032352:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788179020.224141:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788179020.224147:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9bc902f11000 from 39 10000000:01000000:0.0:1788179020.224151:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788179020.224192:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c498a09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179020.224213:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c498a09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179020.224222:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c498a09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179020.224245:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471984384:0@lo:101: 00000100:00100000:0.0:1788179020.224317:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179020.224372:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9137fe000 going to sleep for 11 seconds 00000100:00100000:2.0:1788179020.224524:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471984384 00000100:00100000:2.0:1788179020.224778:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471984384 00000100:00100000:2.0:1788179020.224834:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788179020.224843:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+12:5793:x1875041471984384:12345-0@lo:101: 00010000:00010000:2.0:1788179020.224882:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179020.224899:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9136c5a00/0xaa4c98508c498a10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c498a09 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179020.224923:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9136c5a00/0xaa4c98508c498a10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c498a09 expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179020.224934:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9136c5a00/0xaa4c98508c498a10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498a09 expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179020.224943:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c5a00, rc 0) 00000100:00100000:2.0:1788179020.224990:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+13:5793:x1875041471984384:12345-0@lo:101: Request processed in 146us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179020.224996:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788179020.225053:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471984384:0@lo:101: 00010000:00010000:2.0:1788179020.225068:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c498a09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a10 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179020.225076:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c498a09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498a10 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179020.225144:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471984512:0@lo:501: 00000100:00100000:2.0:1788179020.225174:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179020.225192:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc91835d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788179020.225209:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471984512 00000100:00100000:2.0:1788179020.225213:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471984512 00000100:00100000:2.0:1788179020.225243:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788179020.225250:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+13:5793:x1875041471984512:12345-0@lo:501: 00000100:00100000:2.0:1788179020.225998:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+13:5793:x1875041471984512:12345-0@lo:501: Request processed in 745us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179020.226018:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788179020.226049:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471984512:0@lo:501: 00000100:00100000:2.0:1788179020.226082:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471984640:0@lo:503: 00000100:00100000:2.0:1788179020.226122:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179020.226132:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc91835d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788179020.226154:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471984640 00000100:00100000:2.0:1788179020.226159:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471984640 00000100:00100000:2.0:1788179020.226176:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788179020.226182:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+13:5793:x1875041471984640:12345-0@lo:503: 00000100:00100000:2.0:1788179020.226793:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+13:5793:x1875041471984640:12345-0@lo:503: Request processed in 608us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179020.226800:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788179020.226835:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471984640:0@lo:503: 00000100:00100000:2.0:1788179020.235047:0:8319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8319:1875041471984768:0@lo:502: 00000100:00100000:2.0:1788179020.235140:0:8319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179020.235201:0:8319:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc918601600 going to sleep for 11 seconds 00000100:00100000:1.0:1788179020.235572:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471984768 00000100:00100000:1.0:1788179020.236023:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471984768 00000100:00100000:1.0:1788179020.236075:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788179020.236084:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+13:8319:x1875041471984768:12345-0@lo:502: 00000100:00100000:1.0:1788179020.237419:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+13:8319:x1875041471984768:12345-0@lo:502: Request processed in 1331us (2274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179020.237430:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788179020.237810:0:8319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8319:1875041471984768:0@lo:502: 00000100:00100000:2.0:1788179020.237904:0:8319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8319:1875041471984896:0@lo:502: 00000100:00100000:2.0:1788179020.238409:0:8319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179020.238454:0:8319:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc91835d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788179020.238786:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471984896 00000100:00100000:1.0:1788179020.238796:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471984896 00000100:00100000:1.0:1788179020.238881:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788179020.238891:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+13:8319:x1875041471984896:12345-0@lo:502: 00000100:00100000:1.0:1788179020.239162:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+13:8319:x1875041471984896:12345-0@lo:502: Request processed in 272us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179020.239170:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788179020.240840:0:8319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8319:1875041471984896:0@lo:502: 00000040:00080000:2.0:1788179020.240897:0:8319:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788179020.243193:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788179020.243234:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788179020.243247:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c498a09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a10 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179020.243260:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c498a09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a10 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788179020.243271:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788179020.243274:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788179020.243277:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788179020.243318:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498a17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179020.243326:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498a17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179020.243336:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498a17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179020.243374:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471985024:0@lo:101: 00000100:00100000:0.0:1788179020.243441:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179020.243493:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9137fe300 going to sleep for 11 seconds 00000100:00100000:1.0:1788179020.243583:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471985024 00000100:00100000:1.0:1788179020.243592:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471985024 00000100:00100000:1.0:1788179020.243643:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788179020.243653:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+13:5793:x1875041471985024:12345-0@lo:101: 00010000:00010000:1.0:1788179020.243666:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179020.243679:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc92e12ce00/0xaa4c98508c498a1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c498a17 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179020.243702:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc92e12ce00/0xaa4c98508c498a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c498a17 expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179020.243713:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc92e12ce00/0xaa4c98508c498a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498a17 expref: 14 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179020.243721:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc92e12ce00, rc 0) 00000100:00100000:1.0:1788179020.243757:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+14:5793:x1875041471985024:12345-0@lo:101: Request processed in 105us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179020.243763:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788179020.245164:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471985024:0@lo:101: 00010000:00010000:0.0:1788179020.245187:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498a17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a1e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179020.245200:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498a17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498a1e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179020.245268:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471985152:0@lo:501: 00000100:00100000:0.0:1788179020.245312:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179020.245357:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9137fe300 going to sleep for 11 seconds 00000100:00100000:1.0:1788179020.246218:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471985152 00000100:00100000:1.0:1788179020.246236:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471985152 00000100:00100000:1.0:1788179020.246284:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788179020.246292:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+14:5793:x1875041471985152:12345-0@lo:501: 00000100:00100000:1.0:1788179020.246822:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+14:5793:x1875041471985152:12345-0@lo:501: Request processed in 529us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179020.246829:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788179020.247031:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471985152:0@lo:501: 00000100:00100000:0.0:1788179020.247069:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471985280:0@lo:503: 00000100:00100000:0.0:1788179020.247110:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179020.247143:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9137fe300 going to sleep for 11 seconds 00000100:00100000:2.0:1788179020.247190:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471985280 00000100:00100000:2.0:1788179020.247196:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471985280 00000100:00100000:2.0:1788179020.247235:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788179020.247242:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+14:5793:x1875041471985280:12345-0@lo:503: 00000100:00100000:2.0:1788179020.247410:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+14:5793:x1875041471985280:12345-0@lo:503: Request processed in 168us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179020.247417:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788179020.248026:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471985280:0@lo:503: 00000100:00100000:1.0:1788179020.249845:0:8320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abb8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8320:1875041471985408:0@lo:502: 00000100:00100000:1.0:1788179020.249936:0:8320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179020.249981:0:8320:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9359ea3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788179020.250068:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471985408 00000100:00100000:0.0:1788179020.250075:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471985408 00000100:00100000:0.0:1788179020.250124:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788179020.250134:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+14:8320:x1875041471985408:12345-0@lo:502: 00000100:00100000:0.0:1788179020.250392:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+14:8320:x1875041471985408:12345-0@lo:502: Request processed in 257us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179020.250400:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788179020.250829:0:8320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abb8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8320:1875041471985408:0@lo:502: 00000020:01000000:1.0:1788179020.250875:0:8320:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788179020.250884:0:8320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788179020.250887:0:8320:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788179020.250892:0:8320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788179020.250916:0:8320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abb8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8320:1875041471985536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788179020.250954:0:8320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179020.250986:0:8320:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9359ea3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788179020.250997:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471985536 00000100:00100000:0.0:1788179020.251019:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471985536 00000100:00100000:0.0:1788179020.251055:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788179020.251063:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+14:8320:x1875041471985536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788179020.251206:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+14:8320:x1875041471985536:12345-0@lo:502:llog_process_th.0 Request processed in 144us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179020.251214:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788179020.251291:0:8320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abb8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8320:1875041471985536:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788179020.251308:0:8320:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788179020.251312:0:8320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788179020.251314:0:8320:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788179020.251318:0:8320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788179020.252013:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788179020.252035:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788179020.252045:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498a17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a1e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179020.252057:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498a17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a1e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788179020.252067:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788179020.252070:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9bc913608800 from 39 10000000:01000000:0.0:1788179020.252073:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788179020.252100:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900031a00/0xaa4c98508c498a25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179020.252108:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc900031a00/0xaa4c98508c498a25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179020.252118:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc900031a00/0xaa4c98508c498a25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179020.252133:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471985664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788179020.252170:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179020.252201:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9137fe0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788179020.252311:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471985664 00000100:00100000:2.0:1788179020.252318:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471985664 00000100:00100000:2.0:1788179020.252356:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788179020.252364:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+14:5793:x1875041471985664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788179020.252374:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179020.252386:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9136c4800/0xaa4c98508c498a2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c498a25 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179020.252418:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9136c4800/0xaa4c98508c498a2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c498a25 expref: 15 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179020.252429:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9136c4800/0xaa4c98508c498a2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498a25 expref: 15 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179020.252438:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c4800, rc 0) 00000100:00100000:2.0:1788179020.252465:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+15:5793:x1875041471985664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179020.252484:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788179020.253029:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471985664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788179020.253045:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc900031a00/0xaa4c98508c498a25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a2c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179020.253055:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc900031a00/0xaa4c98508c498a25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498a2c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179020.253116:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471985792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788179020.253143:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179020.253166:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9137fe0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788179020.253623:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471985792 00000100:00100000:2.0:1788179020.253629:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471985792 00000100:00100000:2.0:1788179020.253660:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788179020.253668:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+15:5793:x1875041471985792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788179020.256778:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+15:5793:x1875041471985792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3101us (3623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179020.256793:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788179020.259753:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471985792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788179020.259832:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471985920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788179020.260063:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179020.260109:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9137fe0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788179020.260164:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471985920 00000100:00100000:2.0:1788179020.260172:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471985920 00000100:00100000:2.0:1788179020.260227:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788179020.260236:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+15:5793:x1875041471985920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788179020.260991:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+15:5793:x1875041471985920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 752us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179020.261013:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788179020.261819:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471985920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788179020.262807:0:8321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8321:1875041471986048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788179020.263672:0:8321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179020.263771:0:8321:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9201456c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788179020.263817:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471986048 00000100:00100000:1.0:1788179020.263826:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471986048 00000100:00100000:1.0:1788179020.264065:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788179020.264077:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+15:8321:x1875041471986048:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788179020.266871:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+15:8321:x1875041471986048:12345-0@lo:502:llog_process_th.0 Request processed in 2768us (3173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179020.266898:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788179020.267482:0:8321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8321:1875041471986048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788179020.267840:0:8321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8321:1875041471986176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788179020.268879:0:8321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179020.268929:0:8321:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9201456c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788179020.270150:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471986176 00000100:00100000:1.0:1788179020.270161:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471986176 00000100:00100000:1.0:1788179020.270213:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788179020.270223:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+15:8321:x1875041471986176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788179020.270555:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+15:8321:x1875041471986176:12345-0@lo:502:llog_process_th.0 Request processed in 333us (1679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179020.270563:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788179020.271055:0:8321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8321:1875041471986176:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788179020.271094:0:8321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788179020.271770:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788179020.271796:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788179020.271808:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900031a00/0xaa4c98508c498a25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a2c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179020.271821:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc900031a00/0xaa4c98508c498a25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a2c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788179020.271831:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788179020.271835:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788179020.271838:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788179020.271906:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc92e12cc00/0xaa4c98508c498a33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179020.271992:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc92e12cc00/0xaa4c98508c498a33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179020.272012:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc92e12cc00/0xaa4c98508c498a33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179020.272039:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abb8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471986304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788179020.272104:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179020.272142:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9359ead80 going to sleep for 11 seconds 00000100:00100000:3.0:1788179020.273287:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471986304 00000100:00100000:3.0:1788179020.273302:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471986304 00000100:00100000:3.0:1788179020.273390:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788179020.273401:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+15:5793:x1875041471986304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788179020.273419:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179020.273440:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9137b5400/0xaa4c98508c498a3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c498a33 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179020.273470:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9137b5400/0xaa4c98508c498a3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c498a33 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179020.273480:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9137b5400/0xaa4c98508c498a3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498a33 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179020.273489:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b5400, rc 0) 00000100:00100000:3.0:1788179020.273558:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+16:5793:x1875041471986304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179020.273565:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788179020.273788:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abb8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471986304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788179020.273804:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc92e12cc00/0xaa4c98508c498a33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a3a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179020.273825:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc92e12cc00/0xaa4c98508c498a33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498a3a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179020.273926:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f6df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471986432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788179020.273959:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179020.273987:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc8013bfa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788179020.274012:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471986432 00000100:00100000:3.0:1788179020.274016:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471986432 00000100:00100000:3.0:1788179020.274039:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788179020.274045:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+16:5793:x1875041471986432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788179020.274295:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+16:5793:x1875041471986432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179020.274301:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788179020.274334:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f6df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471986432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788179020.274364:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f6df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471986560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788179020.274401:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179020.274414:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc8013bfa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788179020.274427:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471986560 00000100:00100000:3.0:1788179020.274431:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471986560 00000100:00100000:3.0:1788179020.274452:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788179020.274458:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+16:5793:x1875041471986560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788179020.274599:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+16:5793:x1875041471986560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179020.274606:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788179020.274649:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f6df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471986560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788179020.274829:0:8324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f6df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8324:1875041471986688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788179020.274883:0:8324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179020.274903:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471986688 00000100:00100000:3.0:1788179020.274906:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471986688 00000100:00100000:3.0:1788179020.274930:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788179020.274935:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+16:8324:x1875041471986688:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788179020.275070:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+16:8324:x1875041471986688:12345-0@lo:502:llog_process_th.0 Request processed in 134us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179020.275077:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788179020.275114:0:8324:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc8013bfe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788179020.275126:0:8324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f6df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8324:1875041471986688:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788179020.275145:0:8324:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788179020.275155:0:8324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788179020.275157:0:8324:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788179020.275162:0:8324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788179020.275181:0:8324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f6df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8324:1875041471986816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788179020.275209:0:8324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179020.275224:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471986816 00000100:00100000:3.0:1788179020.275228:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471986816 00000100:00100000:3.0:1788179020.275246:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788179020.275251:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+16:8324:x1875041471986816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788179020.275347:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+16:8324:x1875041471986816:12345-0@lo:502:llog_process_th.0 Request processed in 96us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179020.275353:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788179020.275378:0:8324:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc8013bfe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788179020.275393:0:8324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f6df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8324:1875041471986816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788179020.275407:0:8324:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788179020.275410:0:8324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788179020.275412:0:8324:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788179020.275415:0:8324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1788179020.275457:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788179020.275472:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788179020.275479:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc92e12cc00/0xaa4c98508c498a33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a3a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179020.275489:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc92e12cc00/0xaa4c98508c498a33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a3a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788179020.275499:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788179020.275502:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9bc9070e2800 from 39 10000000:01000000:3.0:1788179020.275505:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788179020.275525:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5800/0xaa4c98508c498a41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179020.275533:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5800/0xaa4c98508c498a41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179020.275542:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5800/0xaa4c98508c498a41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179020.275555:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f6df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471986944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788179020.275578:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179020.275591:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc8013bfe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788179020.275601:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471986944 00000100:00100000:3.0:1788179020.275605:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471986944 00000100:00100000:3.0:1788179020.275632:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788179020.275638:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+16:5793:x1875041471986944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788179020.275645:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179020.275657:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9137b5c00/0xaa4c98508c498a48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c498a41 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179020.275675:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9137b5c00/0xaa4c98508c498a48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c498a41 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179020.275684:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9137b5c00/0xaa4c98508c498a48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498a41 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179020.275692:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b5c00, rc 0) 00000100:00100000:3.0:1788179020.275719:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+17:5793:x1875041471986944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179020.275725:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788179020.275752:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f6df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471986944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788179020.275762:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5800/0xaa4c98508c498a41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a48 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179020.275768:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5800/0xaa4c98508c498a41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498a48 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179020.275801:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f6df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471987072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788179020.275822:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179020.275833:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc8013bfe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788179020.275844:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471987072 00000100:00100000:3.0:1788179020.275871:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471987072 00000100:00100000:3.0:1788179020.275900:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788179020.275906:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+17:5793:x1875041471987072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788179020.281221:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+17:5793:x1875041471987072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5304us (5387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179020.281236:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788179020.285035:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f6df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471987072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788179020.285103:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471987200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788179020.285184:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179020.285266:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc920145cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788179020.286225:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471987200 00000100:00100000:0.0:1788179020.286235:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471987200 00000100:00100000:0.0:1788179020.286294:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788179020.286304:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+17:5793:x1875041471987200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788179020.286830:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+17:5793:x1875041471987200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 526us (1644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179020.286840:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788179020.286979:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471987200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788179020.287312:0:8326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f6ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8326:1875041471987328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788179020.287379:0:8326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179020.287417:0:8326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc8013bf300 going to sleep for 11 seconds 00000100:00100000:0.0:1788179020.287639:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471987328 00000100:00100000:0.0:1788179020.287647:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471987328 00000100:00100000:0.0:1788179020.287686:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788179020.287694:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+17:8326:x1875041471987328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788179020.287918:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+17:8326:x1875041471987328:12345-0@lo:502:llog_process_th.0 Request processed in 224us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179020.287933:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788179020.288163:0:8326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f6ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8326:1875041471987328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788179020.288209:0:8326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f6ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8326:1875041471987456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788179020.288244:0:8326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179020.288272:0:8326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc8013bf300 going to sleep for 11 seconds 00000100:00100000:0.0:1788179020.288312:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471987456 00000100:00100000:0.0:1788179020.288317:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471987456 00000100:00100000:0.0:1788179020.288418:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788179020.288426:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+17:8326:x1875041471987456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788179020.288719:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+17:8326:x1875041471987456:12345-0@lo:502:llog_process_th.0 Request processed in 293us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179020.288727:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788179020.292065:0:8326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f6ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8326:1875041471987456:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788179020.292144:0:8326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788179020.295031:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788179020.295066:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788179020.295078:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5800/0xaa4c98508c498a41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a48 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179020.295091:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5800/0xaa4c98508c498a41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a48 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788179020.295102:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788179020.295104:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788179020.295107:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788179020.295147:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900030c00/0xaa4c98508c498a4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179020.295155:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc900030c00/0xaa4c98508c498a4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179020.295166:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc900030c00/0xaa4c98508c498a4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179020.295191:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471987584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788179020.295264:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179020.295309:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9137fed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788179020.295366:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471987584 00000100:00100000:1.0:1788179020.295373:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471987584 00000100:00100000:1.0:1788179020.295427:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788179020.295436:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+17:5793:x1875041471987584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788179020.295449:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179020.295462:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc92e12da00/0xaa4c98508c498a56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c498a4f expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179020.295495:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc92e12da00/0xaa4c98508c498a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c498a4f expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179020.295505:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc92e12da00/0xaa4c98508c498a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498a4f expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179020.295514:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc92e12da00, rc 0) 00000100:00100000:1.0:1788179020.295564:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041471987584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179020.295571:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788179020.295743:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471987584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788179020.295758:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc900030c00/0xaa4c98508c498a4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a56 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179020.295766:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc900030c00/0xaa4c98508c498a4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498a56 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179020.295821:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471987712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788179020.295889:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179020.295903:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc920145e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788179020.295996:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471987712 00000100:00100000:0.0:1788179020.296010:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471987712 00000100:00100000:0.0:1788179020.296040:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788179020.296047:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041471987712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788179020.296307:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041471987712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179020.296314:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788179020.296426:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471987712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788179020.296454:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471987840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788179020.296504:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179020.296513:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc920145e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788179020.296611:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471987840 00000100:00100000:1.0:1788179020.296617:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471987840 00000100:00100000:1.0:1788179020.296635:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788179020.296641:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041471987840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788179020.296784:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041471987840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179020.296791:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788179020.297142:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471987840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788179020.300670:0:8327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f6ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8327:1875041471987968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788179020.300756:0:8327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179020.300803:0:8327:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc8013bf840 going to sleep for 11 seconds 00000100:00100000:0.0:1788179020.300888:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471987968 00000100:00100000:0.0:1788179020.300896:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471987968 00000100:00100000:0.0:1788179020.300937:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788179020.300947:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+18:8327:x1875041471987968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788179020.301211:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+18:8327:x1875041471987968:12345-0@lo:502:llog_process_th.0 Request processed in 265us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179020.301220:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788179020.301384:0:8327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f6ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8327:1875041471987968:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788179020.301418:0:8327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788179020.301428:0:8327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788179020.301430:0:8327:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788179020.301436:0:8327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788179020.301462:0:8327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f6ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8327:1875041471988096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788179020.301518:0:8327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179020.301538:0:8327:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc8013bf840 going to sleep for 11 seconds 00000100:00100000:0.0:1788179020.301762:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471988096 00000100:00100000:0.0:1788179020.301766:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471988096 00000100:00100000:0.0:1788179020.301802:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788179020.301810:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+18:8327:x1875041471988096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788179020.301984:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+18:8327:x1875041471988096:12345-0@lo:502:llog_process_th.0 Request processed in 174us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179020.301990:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788179020.302139:0:8327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f6ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8327:1875041471988096:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788179020.302159:0:8327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788179020.302164:0:8327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788179020.302166:0:8327:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788179020.302170:0:8327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788179020.302330:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788179020.302362:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788179020.302374:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900030c00/0xaa4c98508c498a4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a56 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179020.302392:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc900030c00/0xaa4c98508c498a4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a56 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788179020.302404:0:5793:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788179020.302407:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9bc9265819c0 from 1 10000000:01000000:0.0:1788179020.302410:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788179020.302440:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900031600/0xaa4c98508c498a5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179020.302448:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc900031600/0xaa4c98508c498a5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179020.302458:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc900031600/0xaa4c98508c498a5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179020.302487:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471988224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788179020.302520:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179020.302552:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9137fe840 going to sleep for 11 seconds 00000100:00100000:3.0:1788179020.302709:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471988224 00000100:00100000:3.0:1788179020.302714:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471988224 00000100:00100000:3.0:1788179020.302749:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788179020.302756:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041471988224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788179020.302765:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179020.302778:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9137b4000/0xaa4c98508c498a64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c498a5d expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179020.302801:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9137b4000/0xaa4c98508c498a64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c498a5d expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179020.302811:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9137b4000/0xaa4c98508c498a64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498a5d expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179020.302820:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4000, rc 0) 00000100:00100000:3.0:1788179020.302870:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:5793:x1875041471988224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179020.302876:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788179020.302944:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471988224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788179020.302956:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc900031600/0xaa4c98508c498a5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a64 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179020.302965:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc900031600/0xaa4c98508c498a5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498a64 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179020.303018:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471988352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788179020.303043:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179020.303075:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9137fe840 going to sleep for 11 seconds 00000100:00100000:0.0:1788179020.303087:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471988352 00000100:00100000:0.0:1788179020.303090:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471988352 00000100:00100000:0.0:1788179020.303110:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788179020.303116:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:5793:x1875041471988352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788179020.303436:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:5793:x1875041471988352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 215us (288us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788179020.303445:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788179020.303554:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471988352:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788179020.303573:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788179020.303579:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900031600/0xaa4c98508c498a5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a64 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179020.303587:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc900031600/0xaa4c98508c498a5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a64 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788179021.031453:0:8360:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd9a980a00 20000000:00000080:2.0:1788179021.031474:0:8360:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bc93b643000 uarg=0000000000000000 20000000:01000000:2.0:1788179021.031514:0:8360:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788179021.031519:0:8360:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788179021.031525:0:8360:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788179021.033627:0:8361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788179021.033871:0:8360:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788179021.039128:0:8360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788179021.039184:0:8360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788179021.039239:0:8360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788179021.039265:0:8360:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788179021.039290:0:8360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bc900030000/0xaa4c98508c498a6b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179021.039310:0:8360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc942173c00/0xaa4c98508c4987e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c4987d9 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179021.039318:0:8360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc900030a00/0xaa4c98508c498842 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c49883b expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179021.039339:0:8360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc9136c5200/0xaa4c98508c49890d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498906 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179021.039348:0:8360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc942173000/0xaa4c98508c4989ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e90 expref: 9 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179021.039356:0:8360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bc900030000/0xaa4c98508c498a6b lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179021.039398:0:8360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc942173000/0xaa4c98508c4989ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e90 expref: 9 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179021.039415:0:8360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bc942173000/0xaa4c98508c4989ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e90 expref: 9 pid: 5790 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179021.039431:0:8360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8360:1875041471988480:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788179021.039544:0:8360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc9136c5200/0xaa4c98508c49890d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c498906 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179021.039552:0:8360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bc9136c5200/0xaa4c98508c49890d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c498906 expref: 18 pid: 5790 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179021.039561:0:8360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8360:1875041471988608:0@lo:104: 00000100:00100000:0.0:1788179021.039604:0:8360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788179021.039636:0:8360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc900030a00/0xaa4c98508c498842 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c49883b expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179021.039644:0:8360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bc900030a00/0xaa4c98508c498842 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c49883b expref: 18 pid: 5791 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179021.039662:0:8360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8360:1875041471988736:0@lo:104: 00000100:00100000:0.0:1788179021.039687:0:8360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788179021.039720:0:8360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc942173c00/0xaa4c98508c4987e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c4987d9 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179021.039728:0:8360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bc942173c00/0xaa4c98508c4987e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c4987d9 expref: 18 pid: 5791 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179021.039736:0:8360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8360:1875041471988864:0@lo:104: 00000100:00100000:0.0:1788179021.039755:0:8360:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc902ea6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788179021.040735:0:5780:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788179021.040769:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179021.040782:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471988608 00000100:00100000:1.0:1788179021.040788:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471988608 00000100:00100000:1.0:1788179021.040821:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471988736 00000100:00100000:1.0:1788179021.040823:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471988736 00000100:00100000:1.0:1788179021.040832:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471988864 00000100:00100000:1.0:1788179021.040834:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471988864 00000100:00100000:1.0:1788179021.040845:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788179021.040879:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+5:8360:x1875041471988608:12345-0@lo:104: 00010000:00010000:1.0:1788179021.040893:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4600/0xaa4c98508c498906 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c49890d expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.040944:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788179021.040949:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+5:8360:x1875041471988608:12345-0@lo:104: Request processed in 72us (1346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179021.040956:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788179021.040971:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788179021.040977:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f912050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+4:8360:x1875041471988736:12345-0@lo:104: 00010000:00010000:1.0:1788179021.040984:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc901499e00/0xaa4c98508c49883b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498842 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.041024:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788179021.041030:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f912050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+4:8360:x1875041471988736:12345-0@lo:104: Request processed in 53us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179021.041035:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788179021.041081:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788179021.041087:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+3:8360:x1875041471988864:12345-0@lo:104: 00010000:00010000:1.0:1788179021.041094:0:5780:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc91317f000/0xaa4c98508c4987d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c4987e0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.041523:0:5780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788179021.041529:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efc6f743-3303-46d5-8807-513b82cac1cc+3:8360:x1875041471988864:12345-0@lo:104: Request processed in 442us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179021.041536:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788179021.041555:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788179021.041561:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4600/0xaa4c98508c498906 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c49890d expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.041568:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c4600 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:1.0:1788179021.041571:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4600/0xaa4c98508c498906 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c49890d expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.041579:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4600/0xaa4c98508c498906 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c49890d expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788179021.041585:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4600/0xaa4c98508c498906 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c49890d expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788179021.041591:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788179021.041622:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4600/0xaa4c98508c498906 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c49890d expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.041629:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788179021.041663:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4600/0xaa4c98508c498906 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c49890d expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.041669:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4600/0xaa4c98508c498906 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c49890d expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.041692:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788179021.041695:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc901499e00/0xaa4c98508c49883b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498842 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.041701:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc901499e00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:1.0:1788179021.041703:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc901499e00/0xaa4c98508c49883b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c498842 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.041709:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc901499e00/0xaa4c98508c49883b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c498842 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788179021.041715:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc901499e00/0xaa4c98508c49883b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c498842 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788179021.041719:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788179021.041733:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc901499e00/0xaa4c98508c49883b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498842 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.041738:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788179021.041752:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc901499e00/0xaa4c98508c49883b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498842 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.041758:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc901499e00/0xaa4c98508c49883b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498842 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.041766:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788179021.041769:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc91317f000/0xaa4c98508c4987d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c4987e0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.041783:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f000 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:1.0:1788179021.041786:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc91317f000/0xaa4c98508c4987d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c4987e0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.041792:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc91317f000/0xaa4c98508c4987d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c4987e0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788179021.041798:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc91317f000/0xaa4c98508c4987d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c4987e0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788179021.041803:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788179021.041817:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc91317f000/0xaa4c98508c4987d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c4987e0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.041822:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788179021.041829:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc91317f000/0xaa4c98508c4987d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c4987e0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.041835:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc91317f000/0xaa4c98508c4987d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c4987e0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.041874:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179021.041876:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179021.041878:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179021.041884:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179021.041897:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471988992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788179021.041933:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179021.041978:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041471989120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788179021.042018:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179021.042036:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788179021.042042:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041471989248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788179021.043565:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179021.043626:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471988992 00000100:00100000:1.0:1788179021.043632:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471988992 00010000:00010000:3.0:1788179021.043842:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179021.043891:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471989120 00000100:00100000:3.0:1788179021.043896:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471989120 00010000:00010000:3.0:1788179021.043926:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc900030a00/0xaa4c98508c498842 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c49883b expref: 20 pid: 5791 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179021.043959:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471989248 00000100:00100000:3.0:1788179021.043962:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471989248 00010000:00010000:3.0:1788179021.043974:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc942173c00/0xaa4c98508c4987e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c4987d9 expref: 21 pid: 5791 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179021.043988:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788179021.044007:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+21:3305:x1875041471989120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788179021.044020:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179021.044026:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc900030a00/0xaa4c98508c498842 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c49883b expref: 21 pid: 5791 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179021.044035:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc900030a00/0xaa4c98508c498842 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c49883b expref: 21 pid: 5791 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179021.044063:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179021.044100:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+21:3305:x1875041471989120:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (2081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179021.044106:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788179021.044429:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788179021.044512:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+20:3305:x1875041471989248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788179021.044521:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179021.044525:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc942173c00/0xaa4c98508c4987e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c4987d9 expref: 20 pid: 5791 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179021.044533:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc942173c00/0xaa4c98508c4987e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c4987d9 expref: 20 pid: 5791 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179021.044544:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179021.044579:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+20:3305:x1875041471989248:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179021.044585:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788179021.044656:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179021.044671:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450989312 00000100:00100000:3.0:1788179021.044676:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450989312 00010000:00010000:3.0:1788179021.044689:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc942173000/0xaa4c98508c4989ca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e90 expref: 10 pid: 5790 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179021.044702:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:3.0:1788179021.044709:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:2356:x1875041450989312:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788179021.044716:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179021.044720:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc942173000/0xaa4c98508c4989ca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e90 expref: 10 pid: 5790 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179021.044730:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc942173000/0xaa4c98508c4989ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e90 expref: 10 pid: 5790 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179021.044741:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179021.044776:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:2356:x1875041450989312:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 68us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179021.044782:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 23 00010000:00010000:1.0:1788179021.045160:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc9136c5200/0xaa4c98508c49890d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c498906 expref: 19 pid: 5790 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179021.045180:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788179021.045185:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efc6f743-3303-46d5-8807-513b82cac1cc+19:3308:x1875041471988992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788179021.045193:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788179021.045197:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc9136c5200/0xaa4c98508c49890d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c498906 expref: 19 pid: 5790 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.045205:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc9136c5200/0xaa4c98508c49890d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c498906 expref: 19 pid: 5790 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.045229:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bc900030000/0xaa4c98508c498a6b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.045239:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc900030000/0xaa4c98508c498a6b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.046208:0:5782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bc900030000/0xaa4c98508c498a6b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.046223:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bc900030000/0xaa4c98508c498a6b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.046231:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bc900030000/0xaa4c98508c498a6b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.046389:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bc900030000/0xaa4c98508c498a6b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.046396:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc900030000 already unused, calling callback (ffffffffc1644220) 00010000:00010000:1.0:1788179021.046401:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bc900030000/0xaa4c98508c498a6b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.046410:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bc900030000/0xaa4c98508c498a6b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.046421:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bc900030000/0xaa4c98508c498a6b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.046492:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788179021.046561:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efc6f743-3303-46d5-8807-513b82cac1cc+19:3308:x1875041471988992:12345-0@lo:103:ldlm_bl.0 Request processed in 1372us (4624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179021.046570:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788179021.046623:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041471989248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788179021.046633:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041471989120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788179021.046664:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471988992:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788179021.047404:0:8360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc942173000/0xaa4c98508c4989ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e90 expref: 9 pid: 5790 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179021.047421:0:8360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8360:1875041471988480:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788179021.047433:0:8360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc9136c5200/0xaa4c98508c49890d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c498906 expref: 18 pid: 5790 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179021.047442:0:8360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8360:1875041471988608:0@lo:104: 00010000:00010000:0.0:1788179021.047451:0:8360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc900030a00/0xaa4c98508c498842 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c49883b expref: 17 pid: 5791 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179021.047459:0:8360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8360:1875041471988736:0@lo:104: 00010000:00010000:0.0:1788179021.047484:0:8360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc942173c00/0xaa4c98508c4987e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c4987d9 expref: 16 pid: 5791 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179021.047493:0:8360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8360:1875041471988864:0@lo:104: 00010000:00010000:0.0:1788179021.047519:0:8360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bc900030000/0xaa4c98508c498a6b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179021.047540:0:8360:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bc900030000/0xaa4c98508c498a6b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179021.047545:0:8360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bc900030000/0xaa4c98508c498a6b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179021.047551:0:8360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc900030000/0xaa4c98508c498a6b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179021.055991:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179022.026459:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179022.026492:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450989440 00000100:00100000:3.0:1788179022.026500:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450989440 00000100:00100000:3.0:1788179022.026552:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 172 00000100:00100000:3.0:1788179022.026563:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+9:5572:x1875041450989440:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788179022.026579:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179022.026605:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9137b4400/0xaa4c98508c498a72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x34c7c42474661ecf expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179022.026634:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9137b4400/0xaa4c98508c498a72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ecf expref: 10 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179022.026646:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9137b4400/0xaa4c98508c498a72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ecf expref: 10 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179022.026655:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4400, rc 0) 00000100:00100000:3.0:1788179022.026708:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:5572:x1875041450989440:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 Request processed in 146us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179022.026714:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 172 00000100:00100000:2.0:1788179022.038370:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179022.038930:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450989568 00000100:00100000:3.0:1788179022.038940:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450989568 00000100:00100000:3.0:1788179022.039000:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 173 00000100:00100000:3.0:1788179022.039011:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:5572:x1875041450989568:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788179022.039474:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:5572:x1875041450989568:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 Request processed in 464us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179022.039482:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 173 00000100:00100000:2.0:1788179022.053005:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179022.053153:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450989696 00000100:00100000:3.0:1788179022.053163:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450989696 00000100:00100000:3.0:1788179022.053441:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 174 00000100:00100000:3.0:1788179022.053452:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:5572:x1875041450989696:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788179022.053703:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:5572:x1875041450989696:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 Request processed in 253us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179022.053711:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 174 00000100:00100000:0.0:1788179022.058252:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179022.058953:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450989824 00000100:00100000:3.0:1788179022.058964:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450989824 00000100:00100000:3.0:1788179022.059037:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 175 00000100:00100000:3.0:1788179022.059048:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:6095:x1875041450989824:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788179022.059308:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:6095:x1875041450989824:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 262us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179022.059317:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 175 00000100:00100000:2.0:1788179022.066674:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179022.067051:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450989952 00000100:00100000:3.0:1788179022.067062:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450989952 00000100:00100000:3.0:1788179022.067123:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 176 00000100:00100000:3.0:1788179022.067133:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:6095:x1875041450989952:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788179022.067393:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:6095:x1875041450989952:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 260us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179022.067401:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 176 00010000:00010000:1.0:1788179022.081248:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788179022.602589:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788179022.602597:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bc902f11000 from 4 10000000:01000000:1.0:1788179022.602602:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788179022.602644:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d800/0xaa4c98508c498a79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179022.602667:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d800/0xaa4c98508c498a79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179022.602679:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d800/0xaa4c98508c498a79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179022.602704:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471989376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788179022.602777:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179022.602836:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc907091840 going to sleep for 11 seconds 00000100:00100000:0.0:1788179022.606667:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471989376 00000100:00100000:0.0:1788179022.606684:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471989376 00000100:00100000:0.0:1788179022.606764:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788179022.606774:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+16:5793:x1875041471989376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788179022.606794:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179022.606816:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc900030400/0xaa4c98508c498a80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c498a79 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179022.606874:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc900030400/0xaa4c98508c498a80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c498a79 expref: 17 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179022.606886:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc900030400/0xaa4c98508c498a80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498a79 expref: 17 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179022.606896:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc900030400, rc 0) 00000100:00100000:0.0:1788179022.606994:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+17:5793:x1875041471989376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 221us (4217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179022.607002:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788179022.607122:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471989376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788179022.607142:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d800/0xaa4c98508c498a79 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a80 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179022.607152:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d800/0xaa4c98508c498a79 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498a80 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179022.607227:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471989504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788179022.607266:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179022.607306:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc926544540 going to sleep for 11 seconds 00000100:00100000:0.0:1788179022.607354:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471989504 00000100:00100000:0.0:1788179022.607359:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471989504 00000100:00100000:0.0:1788179022.607388:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788179022.607396:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+17:5793:x1875041471989504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788179022.607634:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+17:5793:x1875041471989504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179022.607641:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788179022.607707:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471989504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788179022.607736:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471989632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788179022.607773:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179022.607791:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc926544540 going to sleep for 11 seconds 00000100:00100000:0.0:1788179022.607830:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471989632 00000100:00100000:0.0:1788179022.607834:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471989632 00000100:00100000:0.0:1788179022.608050:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788179022.608058:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+17:5793:x1875041471989632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788179022.608194:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+17:5793:x1875041471989632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179022.608201:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788179022.608739:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471989632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788179022.616500:0:8423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f6dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8423:1875041471989760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788179022.616762:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179022.616808:0:8423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93fad99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788179022.619930:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471989760 00000100:00100000:1.0:1788179022.619946:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471989760 00000100:00100000:1.0:1788179022.620023:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788179022.620035:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+17:8423:x1875041471989760:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788179022.620307:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+17:8423:x1875041471989760:12345-0@lo:502:llog_process_th.0 Request processed in 274us (3544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179022.620315:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788179022.620323:0:8423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f6dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8423:1875041471989760:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788179022.620357:0:8423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788179022.620367:0:8423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788179022.620369:0:8423:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788179022.620375:0:8423:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bc902f11000 00000020:00000080:3.0:1788179022.620378:0:8423:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788179022.620463:0:8423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f6dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8423:1875041471989888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788179022.620505:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179022.620547:0:8423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93fad99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788179022.624060:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471989888 00000100:00100000:1.0:1788179022.624075:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471989888 00000100:00100000:1.0:1788179022.624124:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788179022.624135:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+17:8423:x1875041471989888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788179022.624396:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+17:8423:x1875041471989888:12345-0@lo:502:llog_process_th.0 Request processed in 262us (3889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179022.624403:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788179022.624832:0:8423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f6dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8423:1875041471989888:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788179022.624881:0:8423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788179022.624888:0:8423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788179022.624891:0:8423:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788179022.624895:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788179022.624962:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788179022.624995:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788179022.625005:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d800/0xaa4c98508c498a79 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a80 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179022.625023:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d800/0xaa4c98508c498a79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a80 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788179022.625034:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788179022.625037:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bc913608800 from 4 10000000:01000000:1.0:1788179022.625040:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788179022.625070:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d000/0xaa4c98508c498a87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179022.625077:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d000/0xaa4c98508c498a87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179022.625086:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d000/0xaa4c98508c498a87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179022.625106:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471990016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788179022.625145:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179022.625174:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc907091240 going to sleep for 11 seconds 00000100:00100000:1.0:1788179022.625190:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471990016 00000100:00100000:1.0:1788179022.625194:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471990016 00000100:00100000:1.0:1788179022.625220:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788179022.625228:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+17:5793:x1875041471990016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788179022.625238:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179022.625250:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc92e12dc00/0xaa4c98508c498a8e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c498a87 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179022.625272:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc92e12dc00/0xaa4c98508c498a8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c498a87 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179022.625295:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc92e12dc00/0xaa4c98508c498a8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498a87 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179022.625304:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc92e12dc00, rc 0) 00000100:00100000:1.0:1788179022.625333:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041471990016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179022.625340:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788179022.625372:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471990016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788179022.625384:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d000/0xaa4c98508c498a87 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a8e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179022.625393:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d000/0xaa4c98508c498a87 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498a8e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179022.625432:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471990144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788179022.625455:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179022.625467:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc907091240 going to sleep for 11 seconds 00000100:00100000:1.0:1788179022.625477:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471990144 00000100:00100000:1.0:1788179022.625480:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471990144 00000100:00100000:1.0:1788179022.625499:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788179022.625504:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041471990144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788179022.625701:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041471990144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 196us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179022.625707:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788179022.625736:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471990144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788179022.625767:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471990272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788179022.625797:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179022.625809:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc907091240 going to sleep for 11 seconds 00000100:00100000:1.0:1788179022.625819:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471990272 00000100:00100000:1.0:1788179022.625822:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471990272 00000100:00100000:1.0:1788179022.625838:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788179022.625844:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90353a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041471990272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788179022.625993:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90353a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041471990272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179022.625999:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788179022.626034:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471990272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788179022.648922:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f6dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8427:1875041471990400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788179022.649023:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179022.649072:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93fad9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788179022.652796:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471990400 00000100:00100000:1.0:1788179022.652812:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471990400 00000100:00100000:1.0:1788179022.652889:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788179022.652900:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc903538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+18:8427:x1875041471990400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788179022.653336:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc903538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+18:8427:x1875041471990400:12345-0@lo:502:llog_process_th.0 Request processed in 438us (4312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179022.653344:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788179022.662267:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f6dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8427:1875041471990400:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788179022.662358:0:8427:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788179022.662373:0:8427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788179022.662376:0:8427:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788179022.662384:0:8427:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bc913608800 00000020:00000080:0.0:1788179022.662387:0:8427:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788179022.662473:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8427:1875041471990528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788179022.662553:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179022.662594:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471990528 00000100:00100000:0.0:1788179022.662600:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471990528 00000100:00100000:0.0:1788179022.666185:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788179022.666208:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90353b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+18:8427:x1875041471990528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788179022.666481:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90353b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+18:8427:x1875041471990528:12345-0@lo:502:llog_process_th.0 Request processed in 284us (3927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179022.666496:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788179022.666561:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc918352540 going to sleep for 11 seconds 00000100:00100000:0.0:1788179022.666587:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8427:1875041471990528:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788179022.668185:0:8427:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788179022.668200:0:8427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788179022.668202:0:8427:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788179022.668208:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788179022.668724:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788179022.668745:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788179022.668755:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d000/0xaa4c98508c498a87 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a8e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179022.668766:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d000/0xaa4c98508c498a87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a8e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788179022.668790:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788179022.668792:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bc9070e2800 from 4 10000000:01000000:1.0:1788179022.668795:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788179022.668827:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c000/0xaa4c98508c498a95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179022.668835:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c000/0xaa4c98508c498a95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179022.668845:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c000/0xaa4c98508c498a95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179022.668899:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471990656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788179022.668963:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179022.669012:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc902ea6180 going to sleep for 11 seconds 00000100:00100000:0.0:1788179022.669742:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471990656 00000100:00100000:0.0:1788179022.669752:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471990656 00000100:00100000:0.0:1788179022.669804:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788179022.669813:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc903538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041471990656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788179022.669827:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179022.669841:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc900030600/0xaa4c98508c498a9c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c498a95 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179022.669882:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc900030600/0xaa4c98508c498a9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c498a95 expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179022.669894:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc900030600/0xaa4c98508c498a9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498a95 expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179022.669902:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc900030600, rc 0) 00000100:00100000:0.0:1788179022.669958:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc903538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:5793:x1875041471990656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179022.669964:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788179022.670748:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471990656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788179022.670770:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c000/0xaa4c98508c498a95 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a9c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179022.670782:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c000/0xaa4c98508c498a95 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498a9c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179022.670875:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471990784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788179022.670916:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179022.670943:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc902ea6180 going to sleep for 11 seconds 00000100:00100000:0.0:1788179022.671218:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471990784 00000100:00100000:0.0:1788179022.671224:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471990784 00000100:00100000:0.0:1788179022.671260:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788179022.671281:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc903538450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:5793:x1875041471990784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788179022.671557:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc903538450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:5793:x1875041471990784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179022.671564:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788179022.671913:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471990784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788179022.671950:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471990912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788179022.672012:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179022.672032:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc902ea6180 going to sleep for 11 seconds 00000100:00100000:0.0:1788179022.673186:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471990912 00000100:00100000:0.0:1788179022.673197:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471990912 00000100:00100000:0.0:1788179022.673244:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788179022.673253:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc903538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+19:5793:x1875041471990912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788179022.673469:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc903538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+19:5793:x1875041471990912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 217us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179022.673477:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788179022.674761:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041471990912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788179022.685880:0:8431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f6df800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8431:1875041471991040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788179022.685956:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179022.686009:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471991040 00000100:00100000:3.0:1788179022.686016:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471991040 00000100:00100000:3.0:1788179022.686057:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788179022.686066:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90353b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:8431:x1875041471991040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788179022.689943:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90353b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:8431:x1875041471991040:12345-0@lo:502:llog_process_th.0 Request processed in 3868us (3976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179022.689959:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788179022.690047:0:8431:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93fad9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788179022.690075:0:8431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f6df800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8431:1875041471991040:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788179022.690122:0:8431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788179022.690132:0:8431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788179022.690134:0:8431:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788179022.690140:0:8431:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bc9070e2800 00000020:00000080:3.0:1788179022.690143:0:8431:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788179022.693106:0:8431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f6df800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8431:1875041471991168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788179022.693187:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179022.693244:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471991168 00000100:00100000:0.0:1788179022.693251:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471991168 00000100:00100000:3.0:1788179022.693262:0:8431:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93fad9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788179022.693311:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788179022.693319:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc903539c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:8431:x1875041471991168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788179022.693538:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc903539c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:8431:x1875041471991168:12345-0@lo:502:llog_process_th.0 Request processed in 219us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179022.693546:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788179022.698325:0:8431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f6df800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:8431:1875041471991168:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788179022.698371:0:8431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788179022.698380:0:8431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788179022.698383:0:8431:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788179022.698387:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788179022.698457:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788179022.698475:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788179022.698486:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c000/0xaa4c98508c498a95 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a9c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179022.698497:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c000/0xaa4c98508c498a95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a9c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179023.106432:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179023.556521:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471991296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788179023.556600:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179023.557468:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471991296 00000100:00100000:2.0:1788179023.557479:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471991296 00000100:00100000:2.0:1788179023.557544:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788179023.557554:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471991296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788179023.557591:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179023.557653:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471991296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179023.557660:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788179023.557701:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8d5180 x1875041471991296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179039 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179023.557720:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471991296:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788179023.559040:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788179024.129689:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179024.530035:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179024.530066:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179024.530098:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179024.530122:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450990336 00000100:00100000:1.0:1788179024.530124:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179024.530134:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450990336 00000100:00100000:1.0:1788179024.530150:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450990208 00000100:00100000:1.0:1788179024.530154:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450990208 00000100:00100000:1.0:1788179024.530217:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:1.0:1788179024.530229:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2357:x1875041450990208:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179024.530239:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450990464 00000100:00100000:0.0:1788179024.530243:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450990464 00000100:00100000:0.0:1788179024.530264:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:0.0:1788179024.530274:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2357:x1875041450990336:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179024.530311:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2357:x1875041450990208:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 84us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179024.530321:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:0.0:1788179024.530324:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2357:x1875041450990336:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 49us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179024.530333:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:1.0:1788179024.530350:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:1.0:1788179024.530360:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2357:x1875041450990464:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179024.530384:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2357:x1875041450990464:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 25us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179024.530390:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00080000:0.0:1788179024.530448:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788179024.530453:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788179024.530456:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788179024.530764:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450990080 00000100:00100000:3.0:1788179024.530770:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450990080 00000100:00100000:3.0:1788179024.530802:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 192 00000100:00100000:3.0:1788179024.530808:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:2357:x1875041450990080:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788179024.530842:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:2357:x1875041450990080:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 34us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179024.530869:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 192 00000100:00100000:2.0:1788179024.579927:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471991808:0@lo:400:kworker.0 00000100:00100000:2.0:1788179024.580014:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179024.580085:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788179024.580092:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041471991424:0@lo:400:kworker.0 00000100:00100000:2.0:1788179024.580125:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179024.580148:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041471991936:0@lo:400:kworker.0 00000100:00100000:2.0:1788179024.580174:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179024.580203:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041471991552:0@lo:400:kworker.0 00000100:00100000:2.0:1788179024.580225:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179024.580242:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471992064:0@lo:400:kworker.0 00000100:00100000:2.0:1788179024.580262:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179024.580281:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788179024.580287:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041471991680:0@lo:400:kworker.0 00000100:00100000:2.0:1788179024.580305:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179024.580339:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471991808 00000100:00100000:2.0:1788179024.580346:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471991808 00000100:00100000:2.0:1788179024.580398:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471992064 00000100:00100000:2.0:1788179024.580401:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471992064 00000100:00100000:2.0:1788179024.580430:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788179024.580439:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471991808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179024.580488:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471991808:12345-0@lo:400:kworker.0 Request processed in 50us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179024.580496:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788179024.580513:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788179024.580519:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471992064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179024.580550:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471992064:12345-0@lo:400:kworker.0 Request processed in 31us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179024.580556:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788179024.580574:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471991936 00000100:00100000:2.0:1788179024.580577:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471991936 00000100:00100000:2.0:1788179024.580599:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471991552 00000100:00100000:2.0:1788179024.580602:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471991552 00000100:00100000:2.0:1788179024.580610:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471991680 00000100:00100000:2.0:1788179024.580612:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471991680 00000100:00100000:2.0:1788179024.580623:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788179024.580628:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875041471991936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179024.580655:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875041471991936:12345-0@lo:400:kworker.0 Request processed in 27us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179024.580661:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788179024.580670:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788179024.580675:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041471991552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179024.580699:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041471991552:12345-0@lo:400:kworker.0 Request processed in 23us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179024.580713:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788179024.580724:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788179024.580729:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041471991680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179024.580754:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041471991680:12345-0@lo:400:kworker.0 Request processed in 25us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179024.580759:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1788179024.580777:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788179024.580782:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788179024.580820:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041471991680:0@lo:400:kworker.0 00000100:00100000:2.0:1788179024.580831:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041471991552:0@lo:400:kworker.0 00010000:00080000:2.0:1788179024.580843:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8edc00 x1875041471992064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179024.580884:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471992064:0@lo:400:kworker.0 00000100:00100000:2.0:1788179024.580915:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041471991936:0@lo:400:kworker.0 00010000:00080000:2.0:1788179024.580924:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8eea00 x1875041471991808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179024.580932:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471991808:0@lo:400:kworker.0 00000100:00100000:3.0:1788179024.583192:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471991424 00000100:00100000:3.0:1788179024.583206:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471991424 00000100:00100000:3.0:1788179024.583275:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788179024.583285:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:3307:x1875041471991424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179024.583371:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:3307:x1875041471991424:12345-0@lo:400:kworker.0 Request processed in 88us (3245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179024.583390:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788179024.584464:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041471991424:0@lo:400:kworker.0 00000100:00100000:2.0:1788179025.088092:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788179025.088114:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471992192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788179025.088181:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179025.088243:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471992192 00000100:00100000:2.0:1788179025.088257:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471992192 00000100:00100000:2.0:1788179025.088301:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788179025.088310:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471992192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788179025.088350:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179025.088394:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471992192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179025.088401:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788179025.088438:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8eed80 x1875041471992192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179041 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179025.088455:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471992192:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788179025.153028:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179026.177818:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179027.200580:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788179027.849788:0:8661:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1788179028.227418:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179028.678351:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471992320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788179028.678423:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179028.680299:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471992320 00000100:00100000:1.0:1788179028.680313:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471992320 00000100:00100000:1.0:1788179028.680379:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788179028.680390:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471992320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788179028.680428:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788179028.680517:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471992320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (2092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179028.680524:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788179028.680576:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e0c7100 x1875041471992320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788179028.680595:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471992320:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788179028.680942:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788179029.256217:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179029.647953:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179029.647998:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179029.648038:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179029.648070:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179029.648300:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450990592 00000100:00100000:3.0:1788179029.648310:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450990592 00000100:00100000:3.0:1788179029.648362:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 194 00000100:00100000:3.0:1788179029.648371:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:2356:x1875041450990592:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788179029.648438:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:2356:x1875041450990592:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 68us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179029.648446:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 194 00000100:00100000:0.0:1788179029.648723:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450990976 00000100:00100000:0.0:1788179029.648728:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450990976 00000100:00100000:0.0:1788179029.648773:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450990848 00000100:00100000:0.0:1788179029.648776:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450990848 00000100:00100000:0.0:1788179029.648794:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:0.0:1788179029.648800:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2356:x1875041450990976:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179029.648842:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2356:x1875041450990976:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 42us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179029.648877:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:0.0:1788179029.648892:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:0.0:1788179029.648898:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2356:x1875041450990848:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179029.648930:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2356:x1875041450990848:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 32us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179029.648936:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00080000:3.0:1788179029.649643:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788179029.649648:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788179029.651964:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450990720 00000100:00100000:2.0:1788179029.651980:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450990720 00000100:00100000:2.0:1788179029.652049:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:2.0:1788179029.652060:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2356:x1875041450990720:12345-192.168.202.2@tcp:400:kworker.0 00000100:00080000:3.0:1788179029.652070:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788179029.652331:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2356:x1875041450990720:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 273us (4388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179029.652340:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:1.0:1788179029.696749:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788179029.696775:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041471992448:0@lo:400:kworker.0 00000100:00100000:1.0:1788179029.696940:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179029.697002:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471992448 00000100:00100000:1.0:1788179029.697010:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471992448 00000100:00100000:1.0:1788179029.697051:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788179029.697061:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:3307:x1875041471992448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179029.697493:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041471992576:0@lo:400:kworker.0 00000100:00100000:0.0:1788179029.697528:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179029.698045:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:3307:x1875041471992448:12345-0@lo:400:kworker.0 Request processed in 984us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179029.698055:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788179029.698258:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471992576 00000100:00100000:0.0:1788179029.698264:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471992576 00000100:00100000:0.0:1788179029.698312:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788179029.698318:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041471992576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179029.698358:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041471992576:12345-0@lo:400:kworker.0 Request processed in 40us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179029.698364:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788179029.698409:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041471992576:0@lo:400:kworker.0 00000100:00100000:0.0:1788179029.698447:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041471992448:0@lo:400:kworker.0 00000100:00100000:1.0:1788179029.698545:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041471992960:0@lo:400:kworker.0 00000100:00100000:1.0:1788179029.698572:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179029.698592:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788179029.698597:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041471992832:0@lo:400:kworker.0 00000100:00100000:1.0:1788179029.698616:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179029.698945:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471992960 00000100:00100000:3.0:1788179029.698951:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471992960 00000100:00100000:1.0:1788179029.698955:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471992832 00000100:00100000:1.0:1788179029.698964:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471992832 00000100:00100000:3.0:1788179029.698987:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788179029.698987:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788179029.698994:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041471992960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179029.698994:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041471992832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179029.699029:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041471992832:12345-0@lo:400:kworker.0 Request processed in 36us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179029.699035:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788179029.699253:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875041471992704:0@lo:400:kworker.0 00000100:00100000:0.0:1788179029.699282:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179029.699302:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788179029.699308:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041471993088:0@lo:400:kworker.0 00000100:00100000:0.0:1788179029.699330:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179029.699352:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471992704 00000100:00100000:0.0:1788179029.699356:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471992704 00000100:00100000:0.0:1788179029.699382:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788179029.699388:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875041471992704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179029.699434:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875041471992704:12345-0@lo:400:kworker.0 Request processed in 46us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179029.699440:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788179029.699468:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875041471992704:0@lo:400:kworker.0 00010000:00080000:1.0:1788179029.705029:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93539d180 x1875041471992832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788179029.705060:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041471992832:0@lo:400:kworker.0 00000100:00080000:2.0:1788179029.705169:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788179029.710143:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471993088 00000100:00100000:2.0:1788179029.710160:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471993088 00000100:00100000:2.0:1788179029.710229:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788179029.710239:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041471993088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179029.710340:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041471993088:12345-0@lo:400:kworker.0 Request processed in 103us (11009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179029.710348:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788179029.710397:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93539c700 x1875041471993088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179029.710419:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041471993088:0@lo:400:kworker.0 00000100:00080000:2.0:1788179029.710456:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788179029.714079:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041471992960:12345-0@lo:400:kworker.0 Request processed in 15072us (15492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179029.714096:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788179029.714257:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041471992960:0@lo:400:kworker.0 00000100:00100000:1.0:1788179030.208221:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788179030.208246:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471993216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788179030.208319:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179030.208623:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471993216 00000100:00100000:2.0:1788179030.208632:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471993216 00000100:00100000:2.0:1788179030.208699:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788179030.208710:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471993216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788179030.208766:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179030.208831:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471993216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179030.208840:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788179030.209116:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8eed80 x1875041471993216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179030.209136:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471993216:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788179030.272542:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179031.298504:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179032.320131:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788179033.102151:0:8906:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing yml_node 00010000:00010000:1.0:1788179033.346979:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179033.794095:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471993344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788179033.794183:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179033.794896:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471993344 00000100:00100000:2.0:1788179033.794905:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471993344 00000100:00100000:2.0:1788179033.794965:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788179033.794975:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471993344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788179033.795010:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179033.795066:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471993344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179033.795074:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788179033.795097:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788179033.795130:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8ee680 x1875041471993344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179033.795149:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471993344:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788179034.368997:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179034.770360:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179034.770462:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179034.770554:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450991232 00000100:00100000:0.0:1788179034.770566:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450991232 00000100:00100000:0.0:1788179034.770655:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:0.0:1788179034.770665:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2354:x1875041450991232:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179034.770755:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2354:x1875041450991232:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 92us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179034.770763:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00080000:2.0:1788179034.771068:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788179034.771427:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450991104 00000100:00100000:1.0:1788179034.771434:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450991104 00000100:00100000:1.0:1788179034.771517:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 196 00000100:00100000:1.0:1788179034.771525:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:2354:x1875041450991104:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179034.771573:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:2354:x1875041450991104:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 49us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179034.771579:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 196 00000100:00100000:3.0:1788179034.772348:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179034.772377:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179034.772451:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450991360 00000100:00100000:2.0:1788179034.772466:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450991360 00000100:00100000:2.0:1788179034.772532:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450991488 00000100:00100000:2.0:1788179034.772535:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450991488 00000100:00100000:2.0:1788179034.772556:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:2.0:1788179034.772563:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2353:x1875041450991360:12345-192.168.202.2@tcp:9:kworker.0 00000020:00000080:2.0:1788179034.772593:0:6590:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c4989d8 00000100:00080000:2.0:1788179034.772603:0:6590:0:(import.c:65:import_set_state_nolock()) ffff9bc93b620000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788179034.772649:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788179034.773760:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:0.0:1788179034.773776:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2353:x1875041450991488:12345-192.168.202.2@tcp:9:kworker.0 00000020:00000080:0.0:1788179034.773806:0:7778:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c4989df 00000100:00080000:0.0:1788179034.773816:0:7778:0:(import.c:65:import_set_state_nolock()) ffff9bc93b621000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788179034.773878:0:7778:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1788179034.774618:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788179034.774641:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788179034.774646:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788179034.774787:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+2:2353:x1875041450991360:12345-192.168.202.2@tcp:9:kworker.0 Request processed in 2219us (2436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179034.774797:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00010000:00010000:1.0:1788179034.775615:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179034.776254:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+2:2353:x1875041450991488:12345-192.168.202.2@tcp:9:kworker.0 Request processed in 2477us (3870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179034.776265:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:1.0:1788179034.818439:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471993472:0@lo:400:kworker.0 00000100:00100000:1.0:1788179034.818529:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179034.818592:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041471993984:0@lo:400:kworker.0 00000100:00100000:1.0:1788179034.818620:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179034.818660:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788179034.818667:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041471993856:0@lo:400:kworker.0 00000100:00100000:1.0:1788179034.818692:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179034.818955:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041471993600:0@lo:400:kworker.0 00000100:00100000:0.0:1788179034.818987:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179034.819013:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471994112:0@lo:400:kworker.0 00000100:00100000:0.0:1788179034.819034:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179034.819053:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788179034.819058:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041471993728:0@lo:400:kworker.0 00000100:00100000:0.0:1788179034.819077:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179034.819110:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471993984 00000100:00100000:0.0:1788179034.819118:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471993984 00000100:00100000:0.0:1788179034.819166:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471993600 00000100:00100000:0.0:1788179034.819170:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471993600 00000100:00100000:0.0:1788179034.819214:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471993728 00000100:00100000:0.0:1788179034.819218:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471993728 00000100:00100000:0.0:1788179034.819236:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788179034.819245:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041471993984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179034.819298:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041471993984:12345-0@lo:400:kworker.0 Request processed in 54us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179034.819305:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788179034.819327:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788179034.819333:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041471993600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179034.819364:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041471993600:12345-0@lo:400:kworker.0 Request processed in 31us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179034.819370:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788179034.819381:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788179034.819387:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041471993728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179034.819411:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041471993728:12345-0@lo:400:kworker.0 Request processed in 25us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179034.819416:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788179034.819450:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041471993728:0@lo:400:kworker.0 00000100:00100000:0.0:1788179034.819460:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041471993600:0@lo:400:kworker.0 00000100:00100000:3.0:1788179034.819953:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471993856 00000100:00100000:3.0:1788179034.819959:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471993856 00000100:00100000:3.0:1788179034.819997:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471994112 00000100:00100000:3.0:1788179034.820001:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471994112 00000100:00100000:3.0:1788179034.820022:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788179034.820029:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041471993856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179034.820073:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041471993856:12345-0@lo:400:kworker.0 Request processed in 45us (1380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179034.820079:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788179034.820091:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788179034.820097:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471994112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179034.820131:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471994112:12345-0@lo:400:kworker.0 Request processed in 34us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179034.820138:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788179034.820170:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8ef480 x1875041471994112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179034.820181:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471994112:0@lo:400:kworker.0 00000100:00080000:3.0:1788179034.820213:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788179034.820217:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788179034.820383:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8ec000 x1875041471993856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788179034.820394:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041471993856:0@lo:400:kworker.0 00000100:00100000:1.0:1788179034.820405:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041471993984:0@lo:400:kworker.0 00000100:00100000:2.0:1788179034.820576:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471993472 00000100:00100000:2.0:1788179034.820581:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471993472 00000100:00100000:2.0:1788179034.820618:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788179034.820635:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+19:3308:x1875041471993472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179034.820687:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+19:3308:x1875041471993472:12345-0@lo:400:kworker.0 Request processed in 62us (2158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179034.820694:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788179034.821108:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471993472:0@lo:400:kworker.0 00000100:00100000:3.0:1788179035.328529:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041471994240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788179035.328605:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179035.328709:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471994240 00000100:00100000:2.0:1788179035.328718:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471994240 00000100:00100000:2.0:1788179035.328773:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788179035.328783:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041471994240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788179035.328821:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179035.341278:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041471994240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 12483us (12658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179035.341297:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788179035.343630:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8edf80 x1875041471994240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179051 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179035.343662:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041471994240:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788179035.392198:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179036.416084:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788179037.205756:0:9097:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.55.27 00010000:00010000:3.0:1788179037.442340:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788179037.442643:0:6618:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 334bb25c-6762-4beb-8a84-3a838cbc7e80 00000020:00000080:0.0:1788179037.442650:0:6618:0:(genops.c:907:class_export_put()) final put ffff9bc93b625000/334bb25c-6762-4beb-8a84-3a838cbc7e80 00000020:00000080:1.0:1788179037.442903:0:471:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc93b625000/334bb25c-6762-4beb-8a84-3a838cbc7e80 for lustre-OST0000 00000020:00000080:1.0:1788179037.442963:0:471:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9bc93b620000 for lustre-OST0000 00000001:00100000:2.0:1788179037.938478:0:7496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 334bb25c-6762-4beb-8a84-3a838cbc7e80 00000020:00000080:2.0:1788179037.938488:0:7496:0:(genops.c:907:class_export_put()) final put ffff9bc93b623000/334bb25c-6762-4beb-8a84-3a838cbc7e80 00000020:00000080:3.0:1788179037.938622:0:471:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc93b623000/334bb25c-6762-4beb-8a84-3a838cbc7e80 for lustre-OST0001 00000020:00000080:3.0:1788179037.938682:0:471:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9bc93b621000 for lustre-OST0001 00010000:00010000:3.0:1788179038.475978:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179038.912105:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471994368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788179038.912192:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179038.912343:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471994368 00000100:00100000:1.0:1788179038.912353:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471994368 00000100:00100000:1.0:1788179038.912426:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788179038.912437:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471994368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788179038.912485:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788179038.912535:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471994368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179038.912542:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788179038.912795:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788179038.912836:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8efb80 x1875041471994368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179038.912903:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471994368:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788179039.488794:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179039.889671:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179039.889734:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179039.889798:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450991744 00000100:00100000:0.0:1788179039.889807:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450991744 00000100:00100000:0.0:1788179039.889905:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:0.0:1788179039.889916:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f82d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2354:x1875041450991744:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179039.890001:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f82d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2354:x1875041450991744:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 73us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179039.890009:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00080000:1.0:1788179039.890178:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788179039.890299:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450991616 00000100:00100000:2.0:1788179039.890304:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450991616 00000100:00100000:2.0:1788179039.890342:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 198 00000100:00100000:2.0:1788179039.890350:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:2354:x1875041450991616:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788179039.890385:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:2354:x1875041450991616:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 36us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179039.890392:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 198 00000100:00100000:3.0:1788179039.947174:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f82d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471994496:0@lo:400:kworker.0 00000100:00100000:3.0:1788179039.947259:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179039.947984:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471994496 00000100:00100000:0.0:1788179039.947997:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471994496 00000100:00100000:0.0:1788179039.948052:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788179039.948061:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:3308:x1875041471994496:12345-0@lo:400:kworker.0 00000001:02000400:2.0:1788179039.952468:0:9196:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.55.27 00000100:00100000:0.0:1788179039.953561:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:3308:x1875041471994496:12345-0@lo:400:kworker.0 Request processed in 5490us (6290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179039.953575:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788179039.953648:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f82c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471994880:0@lo:400:kworker.0 00000100:00100000:0.0:1788179039.953712:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179039.953767:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f82ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041471994624:0@lo:400:kworker.0 00000100:00100000:0.0:1788179039.953794:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179039.953826:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788179039.953834:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f82c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041471994752:0@lo:400:kworker.0 00000100:00100000:0.0:1788179039.953873:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179039.953906:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471994624 00000100:00100000:0.0:1788179039.953914:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471994624 00000100:00100000:0.0:1788179039.953962:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471994752 00000100:00100000:0.0:1788179039.953966:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471994752 00000100:00100000:0.0:1788179039.953995:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788179039.954003:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041471994624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179039.954053:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041471994624:12345-0@lo:400:kworker.0 Request processed in 51us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179039.954059:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788179039.954072:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788179039.954078:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041471994752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179039.954106:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041471994752:12345-0@lo:400:kworker.0 Request processed in 28us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179039.954112:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1788179039.954131:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788179039.954297:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f82c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041471994752:0@lo:400:kworker.0 00000100:00100000:0.0:1788179039.954311:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f82ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041471994624:0@lo:400:kworker.0 00000100:00100000:0.0:1788179039.954778:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788179039.954789:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f82ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041471995008:0@lo:400:kworker.0 00000100:00100000:0.0:1788179039.954868:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179039.954963:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f82e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471995136:0@lo:400:kworker.0 00000100:00100000:0.0:1788179039.954990:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179039.955020:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471994880 00000100:00100000:0.0:1788179039.955025:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471994880 00000100:00100000:0.0:1788179039.955051:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471995136 00000100:00100000:0.0:1788179039.955053:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471995136 00000100:00100000:0.0:1788179039.955075:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788179039.955081:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471994880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179039.955129:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471994880:12345-0@lo:400:kworker.0 Request processed in 47us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179039.955136:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788179039.955167:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788179039.955174:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471995136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179039.955204:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471995136:12345-0@lo:400:kworker.0 Request processed in 31us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179039.955209:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1788179039.955230:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788179039.955250:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93f82c000 x1875041471994880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179039.955262:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f82c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471994880:0@lo:400:kworker.0 00000100:00100000:0.0:1788179039.955398:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471995008 00000100:00100000:0.0:1788179039.955402:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471995008 00000100:00100000:0.0:1788179039.955435:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788179039.955442:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875041471995008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179039.955475:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875041471995008:12345-0@lo:400:kworker.0 Request processed in 33us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179039.955480:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1788179039.955497:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788179039.955512:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f82ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041471995008:0@lo:400:kworker.0 00010000:00080000:0.0:1788179039.955532:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93f82e680 x1875041471995136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179039.955541:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f82e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471995136:0@lo:400:kworker.0 00000100:00100000:3.0:1788179039.956384:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f82d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471994496:0@lo:400:kworker.0 00000100:00100000:0.0:1788179040.448590:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788179040.448629:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471995264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788179040.448711:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179040.449470:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471995264 00000100:00100000:2.0:1788179040.449480:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471995264 00000100:00100000:2.0:1788179040.449545:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788179040.449554:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471995264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788179040.449588:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179040.449705:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471995264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179040.449713:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788179040.460218:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8ef800 x1875041471995264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179056 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179040.460244:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471995264:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788179040.512021:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179041.535999:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179042.560439:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788179042.592424:0:9294:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.55.27 00010000:00010000:1.0:1788179043.584114:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179044.034725:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471995392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788179044.034811:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179044.034898:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471995392 00000100:00100000:0.0:1788179044.034906:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471995392 00000100:00100000:0.0:1788179044.035025:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788179044.035034:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471995392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788179044.035068:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788179044.035110:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471995392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179044.035116:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788179044.035137:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788179044.035166:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8ef800 x1875041471995392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179060 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179044.035184:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471995392:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788179044.475290:0:9342:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Aug 31 08:24:02 EDT 2026 00010000:00010000:2.0:1788179044.609345:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179045.002975:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179045.003045:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179045.003146:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450991872 00000100:00100000:2.0:1788179045.003160:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450991872 00000100:00100000:2.0:1788179045.003230:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 200 00000100:00100000:2.0:1788179045.003240:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:2354:x1875041450991872:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788179045.003324:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:2354:x1875041450991872:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 86us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179045.003332:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 200 00000100:00100000:0.0:1788179045.003804:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450992000 00000100:00100000:0.0:1788179045.003810:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450992000 00000100:00100000:0.0:1788179045.003892:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:0.0:1788179045.003900:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f82dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2354:x1875041450992000:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179045.003957:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f82dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2354:x1875041450992000:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 58us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179045.003964:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00080000:2.0:1788179045.004352:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788179045.056396:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f82f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471995520:0@lo:400:kworker.0 00000100:00100000:3.0:1788179045.056437:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f82ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875041471995776:0@lo:400:kworker.0 00000100:00100000:1.0:1788179045.056462:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179045.056465:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179045.056507:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f82d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041471996032:0@lo:400:kworker.0 00000100:00100000:0.0:1788179045.056544:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f82ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471995904:0@lo:400:kworker.0 00000100:00100000:3.0:1788179045.063872:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788179045.063894:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f82e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875041471995648:0@lo:400:kworker.0 00000100:00100000:3.0:1788179045.064884:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179045.065631:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f82c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041471996160:0@lo:400:kworker.0 00000100:00100000:1.0:1788179045.067927:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179045.067994:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471995776 00000100:00100000:1.0:1788179045.068002:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471995776 00000100:00100000:1.0:1788179045.068055:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471995648 00000100:00100000:1.0:1788179045.068058:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471995648 00000100:00100000:1.0:1788179045.068068:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471996032 00000100:00100000:1.0:1788179045.068070:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471996032 00000100:00100000:1.0:1788179045.068085:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788179045.068094:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875041471995776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179045.069254:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875041471995776:12345-0@lo:400:kworker.0 Request processed in 1159us (12785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179045.069262:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788179045.069286:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788179045.069293:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875041471995648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179045.069321:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875041471995648:12345-0@lo:400:kworker.0 Request processed in 29us (4440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179045.069328:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788179045.069339:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788179045.069345:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041471996032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179045.069378:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041471996032:12345-0@lo:400:kworker.0 Request processed in 33us (1460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179045.069394:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1788179045.069416:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788179045.069451:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f82d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041471996032:0@lo:400:kworker.0 00000100:00100000:3.0:1788179045.069529:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179045.069563:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f82ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875041471995776:0@lo:400:kworker.0 00000100:00100000:3.0:1788179045.069589:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f82e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875041471995648:0@lo:400:kworker.0 00000100:00100000:3.0:1788179045.069614:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471996160 00000100:00100000:3.0:1788179045.069619:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471996160 00000100:00100000:3.0:1788179045.069657:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788179045.069663:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041471996160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179045.069698:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041471996160:12345-0@lo:400:kworker.0 Request processed in 35us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179045.069703:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788179045.069720:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788179045.069737:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93f82c380 x1875041471996160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179045.069748:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f82c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041471996160:0@lo:400:kworker.0 00000100:00100000:3.0:1788179045.069872:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471995520 00000100:00100000:3.0:1788179045.069877:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471995520 00000100:00100000:3.0:1788179045.069900:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788179045.069905:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:3308:x1875041471995520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179045.069940:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:3308:x1875041471995520:12345-0@lo:400:kworker.0 Request processed in 35us (13478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179045.069946:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788179045.071347:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f82f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471995520:0@lo:400:kworker.0 00000100:00100000:0.0:1788179045.075361:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179045.075404:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471995904 00000100:00100000:1.0:1788179045.075414:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471995904 00000100:00100000:1.0:1788179045.075475:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788179045.075486:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471995904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179045.075561:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471995904:12345-0@lo:400:kworker.0 Request processed in 76us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179045.075568:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788179045.075807:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93f82ce00 x1875041471995904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179045.075821:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f82ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471995904:0@lo:400:kworker.0 00000100:00100000:1.0:1788179045.569846:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788179045.569897:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471996288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788179045.569968:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179045.570064:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471996288 00000100:00100000:1.0:1788179045.570071:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471996288 00000100:00100000:1.0:1788179045.570128:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788179045.570138:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f82d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471996288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788179045.570175:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788179045.570220:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f82d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471996288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179045.570228:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788179045.570265:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8efb80 x1875041471996288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179061 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788179045.570282:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471996288:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788179045.632318:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179046.656334:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179047.680899:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179048.705768:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179049.152182:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788179049.152206:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041471996416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788179049.152274:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179049.152387:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471996416 00000100:00100000:2.0:1788179049.152410:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471996416 00000100:00100000:2.0:1788179049.152476:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788179049.152485:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041471996416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788179049.152517:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179049.152574:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041471996416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179049.152581:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788179049.153054:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788179049.153758:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8edf80 x1875041471996416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179065 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788179049.153780:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041471996416:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788179049.736882:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788179050.120165:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179050.120299:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450992128 00000100:00100000:1.0:1788179050.120308:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450992128 00000100:00100000:1.0:1788179050.120404:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 202 00000100:00100000:1.0:1788179050.120414:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:2357:x1875041450992128:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179050.120497:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:2357:x1875041450992128:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 82us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179050.120505:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 202 00000100:00100000:3.0:1788179050.124602:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179050.124758:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450992256 00000100:00100000:1.0:1788179050.124768:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450992256 00000100:00100000:1.0:1788179050.124885:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:1.0:1788179050.124898:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2357:x1875041450992256:12345-192.168.202.2@tcp:400:kworker.0 00000100:00080000:3.0:1788179050.125081:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788179050.125188:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2357:x1875041450992256:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 292us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179050.125196:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:1.0:1788179050.188537:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f82df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471996544:0@lo:400:kworker.0 00000100:00100000:1.0:1788179050.188635:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179050.188697:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f82f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041471997056:0@lo:400:kworker.0 00000100:00100000:1.0:1788179050.188738:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179050.188771:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788179050.188778:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f82ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041471996928:0@lo:400:kworker.0 00000100:00100000:1.0:1788179050.188804:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179050.188838:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f82fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041471996672:0@lo:400:kworker.0 00000100:00100000:1.0:1788179050.188891:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179050.188912:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f82c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471997184:0@lo:400:kworker.0 00000100:00100000:1.0:1788179050.188935:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179050.189166:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788179050.189174:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f82f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041471996800:0@lo:400:kworker.0 00000100:00100000:1.0:1788179050.189200:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179050.189241:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471996544 00000100:00100000:1.0:1788179050.189250:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471996544 00000100:00100000:1.0:1788179050.189310:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788179050.189320:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+19:3308:x1875041471996544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179050.189381:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+19:3308:x1875041471996544:12345-0@lo:400:kworker.0 Request processed in 62us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179050.189389:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788179050.189425:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471997056 00000100:00100000:1.0:1788179050.189428:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471997056 00000100:00100000:1.0:1788179050.189467:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471996672 00000100:00100000:1.0:1788179050.189470:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471996672 00000100:00100000:1.0:1788179050.189481:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471996800 00000100:00100000:1.0:1788179050.189483:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471996800 00000100:00100000:1.0:1788179050.189497:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788179050.189502:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f82e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041471997056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179050.189535:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f82e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041471997056:12345-0@lo:400:kworker.0 Request processed in 32us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179050.189540:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788179050.189550:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788179050.189557:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f82d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041471996672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179050.189586:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f82d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041471996672:12345-0@lo:400:kworker.0 Request processed in 29us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179050.189600:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788179050.189611:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788179050.189616:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f82ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041471996800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179050.189643:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f82ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041471996800:12345-0@lo:400:kworker.0 Request processed in 27us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179050.189650:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788179050.189669:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471996928 00000100:00100000:1.0:1788179050.189673:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471996928 00000100:00100000:1.0:1788179050.189707:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471997184 00000100:00100000:1.0:1788179050.189710:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471997184 00000100:00100000:1.0:1788179050.189742:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788179050.189749:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f82ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041471996928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179050.189782:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f82ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041471996928:12345-0@lo:400:kworker.0 Request processed in 34us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179050.189788:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788179050.189798:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788179050.189803:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f82e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471997184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179050.189831:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f82e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471997184:12345-0@lo:400:kworker.0 Request processed in 28us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179050.189837:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788179050.189897:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788179050.189902:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788179050.195714:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f82f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041471996800:0@lo:400:kworker.0 00000100:00100000:1.0:1788179050.196894:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f82fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041471996672:0@lo:400:kworker.0 00010000:00080000:1.0:1788179050.196929:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93f82c380 x1875041471997184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788179050.197399:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f82c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471997184:0@lo:400:kworker.0 00010000:00080000:1.0:1788179050.197480:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93f82ce00 x1875041471996928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788179050.197490:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f82ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041471996928:0@lo:400:kworker.0 00000100:00100000:1.0:1788179050.197501:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f82df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471996544:0@lo:400:kworker.0 00000100:00100000:1.0:1788179050.197515:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f82f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041471997056:0@lo:400:kworker.0 00000100:00100000:2.0:1788179050.688562:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788179050.688585:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471997312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788179050.688664:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179050.688728:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471997312 00000100:00100000:2.0:1788179050.688734:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471997312 00000100:00100000:2.0:1788179050.688776:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788179050.688785:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471997312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788179050.688817:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179050.688891:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471997312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179050.688898:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788179050.688937:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8ee680 x1875041471997312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179050.688957:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471997312:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788179050.752638:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179051.778306:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179052.801043:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179053.834775:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179054.276455:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788179054.276477:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f82f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041471997440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788179054.276542:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179054.276601:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471997440 00000100:00100000:1.0:1788179054.276608:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471997440 00000100:00100000:1.0:1788179054.276656:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788179054.276664:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f82df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041471997440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788179054.276708:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788179054.276746:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f82df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041471997440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179054.276753:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788179054.276771:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788179054.276797:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93f82f100 x1875041471997440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788179054.276825:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f82f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041471997440:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788179054.849304:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179055.241732:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179055.241767:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179055.241834:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450992384 00000100:00100000:3.0:1788179055.241844:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450992384 00000100:00100000:3.0:1788179055.241922:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 204 00000100:00100000:3.0:1788179055.241932:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:2355:x1875041450992384:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788179055.241995:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:2355:x1875041450992384:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 65us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179055.242011:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 204 00000100:00100000:1.0:1788179055.242663:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450992512 00000100:00100000:1.0:1788179055.242684:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450992512 00000100:00100000:1.0:1788179055.242731:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:1.0:1788179055.242739:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2355:x1875041450992512:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179055.242779:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2355:x1875041450992512:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 41us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179055.242785:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00080000:3.0:1788179055.243552:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788179055.296219:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041471997696:0@lo:400:kworker.0 00000100:00100000:2.0:1788179055.296410:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471997952:0@lo:400:kworker.0 00000100:00100000:1.0:1788179055.298746:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471997568:0@lo:400:kworker.0 00000100:00100000:2.0:1788179055.299832:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179055.300495:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179055.300523:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471998208:0@lo:400:kworker.0 00000100:00100000:0.0:1788179055.300555:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179055.301465:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788179055.301477:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041471997824:0@lo:400:kworker.0 00000100:00100000:0.0:1788179055.301514:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179055.301556:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471997696 00000100:00100000:0.0:1788179055.301563:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471997696 00000100:00100000:1.0:1788179055.301762:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179055.301800:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041471998080:0@lo:400:kworker.0 00000100:00100000:1.0:1788179055.301824:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179055.301869:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471997952 00000100:00100000:1.0:1788179055.301873:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471997952 00000100:00100000:1.0:1788179055.301907:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471998208 00000100:00100000:1.0:1788179055.301910:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471998208 00000100:00100000:1.0:1788179055.301936:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788179055.301945:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471997952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179055.302009:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471997952:12345-0@lo:400:kworker.0 Request processed in 65us (2179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179055.302016:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788179055.302033:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788179055.302039:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471998208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179055.302075:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471998208:12345-0@lo:400:kworker.0 Request processed in 35us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179055.302082:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788179055.302096:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471997568 00000100:00100000:3.0:1788179055.302102:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471997568 00000100:00100000:1.0:1788179055.302127:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471997824 00000100:00100000:1.0:1788179055.302133:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471997824 00000100:00100000:3.0:1788179055.302136:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788179055.302144:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:3308:x1875041471997568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179055.302181:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471998080 00000100:00100000:1.0:1788179055.302185:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471998080 00000100:00100000:3.0:1788179055.302197:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:3308:x1875041471997568:12345-0@lo:400:kworker.0 Request processed in 52us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179055.302201:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788179055.302210:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788179055.302212:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041471997824:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788179055.302246:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788179055.302252:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788179055.302252:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041471997824:12345-0@lo:400:kworker.0 Request processed in 42us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179055.302261:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788179055.302275:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788179055.302281:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f82f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041471998080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179055.302306:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f82f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041471998080:12345-0@lo:400:kworker.0 Request processed in 25us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179055.302311:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788179055.302662:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788179055.302684:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041471997696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179055.302717:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041471997696:12345-0@lo:400:kworker.0 Request processed in 48us (2224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179055.302733:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788179055.302834:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471997568:0@lo:400:kworker.0 00000100:00100000:3.0:1788179055.302862:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041471998080:0@lo:400:kworker.0 00010000:00080000:1.0:1788179055.303747:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc9358f8380 x1875041471997952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788179055.303761:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471997952:0@lo:400:kworker.0 00000100:00100000:0.0:1788179055.307767:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041471997824:0@lo:400:kworker.0 00000100:00100000:0.0:1788179055.307784:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041471997696:0@lo:400:kworker.0 00010000:00080000:0.0:1788179055.307800:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93b5a8700 x1875041471998208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179055.307810:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471998208:0@lo:400:kworker.0 00000100:00100000:3.0:1788179055.811373:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f6df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041471998336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788179055.811503:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179055.811569:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471998336 00000100:00100000:3.0:1788179055.811633:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471998336 00000100:00100000:3.0:1788179055.811685:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788179055.811703:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041471998336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788179055.811734:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788179055.811773:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041471998336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179055.811780:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788179055.811818:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93f6df480 x1875041471998336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179071 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179055.811835:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f6df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041471998336:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788179055.876455:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179056.897149:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179057.920168:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179058.944522:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788179059.392130:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f82ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471998464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788179059.392200:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179059.392305:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471998464 00000100:00100000:1.0:1788179059.392313:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471998464 00000100:00100000:1.0:1788179059.392370:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788179059.392380:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471998464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788179059.392414:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788179059.392458:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471998464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179059.392466:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1788179059.392503:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93f82ce00 x1875041471998464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179075 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788179059.392532:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f82ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471998464:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788179059.392583:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788179059.974634:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179060.385642:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179060.385720:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179060.385737:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450992640 00000100:00100000:1.0:1788179060.385740:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450992768 00000100:00100000:1.0:1788179060.385746:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450992768 00000100:00100000:2.0:1788179060.385747:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450992640 00000100:00100000:2.0:1788179060.385789:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 206 00000100:00100000:1.0:1788179060.385789:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 59 00000100:00100000:2.0:1788179060.385797:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:2357:x1875041450992640:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179060.385797:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f82ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2357:x1875041450992768:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788179060.385875:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:2357:x1875041450992640:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 78us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179060.385875:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f82ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2357:x1875041450992768:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 78us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179060.385884:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 206 00000100:00100000:1.0:1788179060.385884:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 59 00000100:00080000:1.0:1788179060.385902:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788179060.416157:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041471998720:0@lo:400:kworker.0 00000100:00100000:1.0:1788179060.416157:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471998976:0@lo:400:kworker.0 00000100:00100000:0.0:1788179060.416226:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471998592:0@lo:400:kworker.0 00000100:00100000:3.0:1788179060.419144:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875041471998848:0@lo:400:kworker.0 00000100:00100000:1.0:1788179060.419260:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179060.419339:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471998976 00000100:00100000:1.0:1788179060.419347:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471998976 00000100:00100000:1.0:1788179060.419390:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788179060.419398:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f82c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471998976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179060.419454:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f82c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041471998976:12345-0@lo:400:kworker.0 Request processed in 56us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179060.419461:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788179060.419517:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8eed80 x1875041471998976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788179060.419528:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041471998976:0@lo:400:kworker.0 00000100:00100000:2.0:1788179060.433325:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179060.433399:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471998720 00000100:00100000:2.0:1788179060.433406:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471998720 00000100:00100000:2.0:1788179060.433468:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788179060.433477:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041471998720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179060.434629:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041471998720:12345-0@lo:400:kworker.0 Request processed in 1140us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179060.434640:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788179060.434699:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041471998720:0@lo:400:kworker.0 00000100:00100000:2.0:1788179060.434709:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471999232:0@lo:400:kworker.0 00000100:00100000:2.0:1788179060.434752:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179060.434777:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471999232 00000100:00100000:2.0:1788179060.434781:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471999232 00000100:00100000:2.0:1788179060.434813:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788179060.434819:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471999232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179060.434862:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041471999232:12345-0@lo:400:kworker.0 Request processed in 29us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179060.434868:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1788179060.434881:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788179060.434906:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8ed880 x1875041471999232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179060.434917:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041471999232:0@lo:400:kworker.0 00000100:00100000:3.0:1788179060.436714:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179060.446344:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179060.446398:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041471999104:0@lo:400:kworker.0 00000100:00100000:3.0:1788179060.446414:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471998592 00000100:00100000:3.0:1788179060.446422:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471998592 00000100:00100000:2.0:1788179060.446445:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179060.446475:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788179060.446485:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:3308:x1875041471998592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179060.446537:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:3308:x1875041471998592:12345-0@lo:400:kworker.0 Request processed in 54us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179060.446545:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788179060.456940:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471998592:0@lo:400:kworker.0 00000100:00100000:0.0:1788179060.470685:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471998848 00000100:00100000:0.0:1788179060.470702:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471998848 00000100:00080000:0.0:1788179060.471408:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788179060.471457:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471999104 00000100:00100000:0.0:1788179060.471461:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471999104 00000100:00100000:0.0:1788179060.471503:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788179060.471513:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875041471998848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179060.471609:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875041471998848:12345-0@lo:400:kworker.0 Request processed in 98us (34899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179060.471625:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788179060.471646:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788179060.471653:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041471999104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179060.471685:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041471999104:12345-0@lo:400:kworker.0 Request processed in 33us (25239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179060.471691:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1788179060.471705:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788179060.471794:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875041471998848:0@lo:400:kworker.0 00000100:00100000:2.0:1788179060.471833:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041471999104:0@lo:400:kworker.0 00000001:02000400:0.0:1788179060.721277:0:9973:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 08:24:17 (1788179057) === 00000100:00100000:3.0:1788179060.931918:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041471999360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788179060.931993:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179060.946943:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471999360 00000100:00100000:1.0:1788179060.947332:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471999360 00000100:00100000:1.0:1788179060.947437:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788179060.947446:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041471999360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788179060.947483:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788179060.947701:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041471999360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 255us (15706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179060.947708:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788179060.948058:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93b5a8700 x1875041471999360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179076 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179060.948077:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041471999360:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788179060.991980:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179061.336951:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179061.337267:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450992896 00000100:00100000:2.0:1788179061.337284:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450992896 00000100:00100000:2.0:1788179061.337372:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 208 00000100:00100000:2.0:1788179061.337388:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:8095:x1875041450992896:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788179061.337414:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179061.338168:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9136c5c00/0xaa4c98508c498aa3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x34c7c42474661ed6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179061.338206:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9136c5c00/0xaa4c98508c498aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ed6 expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179061.338220:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9136c5c00/0xaa4c98508c498aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ed6 expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179061.338230:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c5c00, rc 0) 00000100:00100000:2.0:1788179061.338308:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+11:8095:x1875041450992896:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 924us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179061.338317:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 208 00000100:00100000:2.0:1788179061.355970:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179061.356072:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450993024 00000100:00100000:3.0:1788179061.356082:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450993024 00000100:00100000:3.0:1788179061.356135:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 209 00000100:00100000:3.0:1788179061.356146:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+11:8095:x1875041450993024:12345-192.168.202.2@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788179061.356538:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+11:8095:x1875041450993024:12345-192.168.202.2@tcp:501:mount.lustre.0 Request processed in 392us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179061.356557:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 209 00000100:00100000:1.0:1788179061.361971:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179061.362098:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450993152 00000100:00100000:3.0:1788179061.362108:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450993152 00000100:00100000:3.0:1788179061.362164:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 210 00000100:00100000:3.0:1788179061.362174:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+11:8095:x1875041450993152:12345-192.168.202.2@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788179061.362393:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+11:8095:x1875041450993152:12345-192.168.202.2@tcp:503:mount.lustre.0 Request processed in 220us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179061.362401:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 210 00000100:00100000:1.0:1788179061.376988:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179061.377133:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450993280 00000100:00100000:2.0:1788179061.377144:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450993280 00000100:00100000:2.0:1788179061.377207:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 211 00000100:00100000:2.0:1788179061.377216:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+11:8099:x1875041450993280:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788179061.377985:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+11:8099:x1875041450993280:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 306us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179061.377998:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 211 00000100:00100000:0.0:1788179061.404483:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179061.406524:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450993408 00000100:00100000:2.0:1788179061.406541:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450993408 00000100:00100000:2.0:1788179061.406622:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 212 00000100:00100000:2.0:1788179061.406633:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+11:8099:x1875041450993408:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788179061.406958:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+11:8099:x1875041450993408:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 325us (2484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179061.406977:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 212 00000100:00100000:1.0:1788179061.415711:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179061.415811:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450993536 00000100:00100000:3.0:1788179061.415820:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450993536 00000100:00100000:3.0:1788179061.415907:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 213 00000100:00100000:3.0:1788179061.415918:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+11:8095:x1875041450993536:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788179061.415935:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179061.415966:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9137b4a00/0xaa4c98508c498aaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x34c7c42474661f00 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179061.415996:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9137b4a00/0xaa4c98508c498aaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f00 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179061.416007:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9137b4a00/0xaa4c98508c498aaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f00 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179061.416016:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4a00, rc 0) 00000100:00100000:3.0:1788179061.416064:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+12:8095:x1875041450993536:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 148us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179061.416072:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 213 00000100:00100000:1.0:1788179061.428952:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179061.431068:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450993664 00000100:00100000:3.0:1788179061.431084:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450993664 00000100:00100000:3.0:1788179061.431164:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 214 00000100:00100000:3.0:1788179061.431174:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+12:8095:x1875041450993664:12345-192.168.202.2@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788179061.431201:0:5791:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788179061.431226:0:5791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788179061.431230:0:5791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788179061.431234:0:5791:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788179061.431236:0:5791:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788179061.436599:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+12:8095:x1875041450993664:12345-192.168.202.2@tcp:256:mount.lustre.0 Request processed in 5416us (7654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179061.436624:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 214 00000100:00100000:1.0:1788179061.443770:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179061.443889:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450993792 00000100:00100000:2.0:1788179061.443900:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450993792 00000100:00100000:2.0:1788179061.443964:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 215 00000100:00100000:2.0:1788179061.443975:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+12:8095:x1875041450993792:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788179061.443993:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179061.444012:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9136c5000/0xaa4c98508c498ab1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x34c7c42474661f07 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179061.444043:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9136c5000/0xaa4c98508c498ab1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f07 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179061.444054:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9136c5000/0xaa4c98508c498ab1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f07 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179061.444063:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c5000, rc 0) 00000100:00100000:2.0:1788179061.444503:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:8095:x1875041450993792:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 528us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179061.444511:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 215 00000100:00100000:1.0:1788179061.462247:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179061.462578:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450993920 00000100:00100000:3.0:1788179061.462590:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450993920 00000100:00100000:3.0:1788179061.462730:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 216 00000100:00100000:3.0:1788179061.462742:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:8095:x1875041450993920:12345-192.168.202.2@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788179061.463092:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:8095:x1875041450993920:12345-192.168.202.2@tcp:501:mount.lustre.0 Request processed in 352us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179061.463100:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 216 00000100:00100000:0.0:1788179061.471366:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179061.476206:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450994048 00000100:00100000:2.0:1788179061.476222:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450994048 00000100:00100000:2.0:1788179061.476334:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 217 00000100:00100000:2.0:1788179061.476345:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:8095:x1875041450994048:12345-192.168.202.2@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788179061.476621:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:8095:x1875041450994048:12345-192.168.202.2@tcp:503:mount.lustre.0 Request processed in 268us (5255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179061.476630:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 217 00000100:00100000:1.0:1788179061.482989:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179061.490733:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450994176 00000100:00100000:0.0:1788179061.490749:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450994176 00000100:00100000:0.0:1788179061.490817:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 218 00000100:00100000:0.0:1788179061.490826:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:8102:x1875041450994176:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788179061.491114:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:8102:x1875041450994176:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 287us (8134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179061.491122:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 218 00000100:00100000:1.0:1788179061.501702:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179061.501792:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450994304 00000100:00100000:0.0:1788179061.501804:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450994304 00000100:00100000:0.0:1788179061.501890:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 219 00000100:00100000:0.0:1788179061.501901:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:8102:x1875041450994304:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788179061.502148:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:8102:x1875041450994304:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 249us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179061.502157:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 219 00000100:00100000:1.0:1788179061.527557:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179061.527600:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179061.527744:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450994816 00000100:00100000:0.0:1788179061.527755:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450994816 00000100:00100000:0.0:1788179061.527814:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450994432 00000100:00100000:0.0:1788179061.527818:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450994432 00000100:00100000:0.0:1788179061.527836:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00100000:0.0:1788179061.527845:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f82fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2357:x1875041450994816:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179061.527978:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f82fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2357:x1875041450994816:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 133us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179061.527986:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00100000:0.0:1788179061.528008:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:0.0:1788179061.528013:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f82f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2353:x1875041450994432:12345-192.168.202.2@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788179061.528036:0:5798:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 176e2bf4-b5b0-4c8a-ad1b-45962a669671@192.168.202.2@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:0.0:1788179061.528077:0:5798:0:(genops.c:1407:class_connect()) connect: client 176e2bf4-b5b0-4c8a-ad1b-45962a669671, cookie 0xaa4c98508c498ab8 00000004:00100000:0.0:1788179061.528115:0:5798:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788179061.528409:0:5798:0:(import.c:65:import_set_state_nolock()) ffff9bc93f939800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788179061.528446:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f82f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:176e2bf4-b5b0-4c8a-ad1b-45962a669671+6:2353:x1875041450994432:12345-192.168.202.2@tcp:38:mount.lustre.0 Request processed in 431us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179061.528453:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:1.0:1788179061.551994:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179061.552086:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179061.552690:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450994560 00000100:00100000:2.0:1788179061.552701:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450994560 00000100:00100000:2.0:1788179061.552778:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450994688 00000100:00100000:2.0:1788179061.552782:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450994688 00000100:00100000:2.0:1788179061.552805:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:2.0:1788179061.552816:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f82c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:176e2bf4-b5b0-4c8a-ad1b-45962a669671+7:0:x1875041450994560:12345-192.168.202.2@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788179061.552889:0:5797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788179061.552970:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f82c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:176e2bf4-b5b0-4c8a-ad1b-45962a669671+7:0:x1875041450994560:12345-192.168.202.2@tcp:41:mount.lustre.0 Request processed in 155us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179061.552978:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:2.0:1788179061.552996:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:2.0:1788179061.553003:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f82ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:176e2bf4-b5b0-4c8a-ad1b-45962a669671+6:8095:x1875041450994688:12345-192.168.202.2@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788179061.553017:0:5797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788179061.553041:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f82ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:176e2bf4-b5b0-4c8a-ad1b-45962a669671+6:8095:x1875041450994688:12345-192.168.202.2@tcp:41:mount.lustre.0 Request processed in 39us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179061.553048:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00080000:1.0:1788179061.553315:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788179061.558593:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179061.558882:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450994944 00000100:00100000:2.0:1788179061.558892:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450994944 00000100:00100000:2.0:1788179061.558950:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:2.0:1788179061.558961:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:176e2bf4-b5b0-4c8a-ad1b-45962a669671+6:8095:x1875041450994944:12345-192.168.202.2@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788179061.559052:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:176e2bf4-b5b0-4c8a-ad1b-45962a669671+6:8095:x1875041450994944:12345-192.168.202.2@tcp:40:mount.lustre.0 Request processed in 93us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179061.559060:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:1.0:1788179061.581516:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179061.581596:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179061.581740:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450995072 00000100:00100000:3.0:1788179061.581752:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450995072 00000100:00100000:3.0:1788179061.581792:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450995200 00000100:00100000:3.0:1788179061.581796:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450995200 00000100:00100000:3.0:1788179061.581825:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:3.0:1788179061.581834:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f82c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1875041450995072:12345-192.168.202.2@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788179061.581890:0:7778:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 176e2bf4-b5b0-4c8a-ad1b-45962a669671@192.168.202.2@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:3.0:1788179061.581920:0:7778:0:(genops.c:1407:class_connect()) connect: client 176e2bf4-b5b0-4c8a-ad1b-45962a669671, cookie 0xaa4c98508c498abf 00002000:00100000:3.0:1788179061.581938:0:7778:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 176e2bf4-b5b0-4c8a-ad1b-45962a669671/ffff9bc9359e5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211371b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788179061.581961:0:7778:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788179061.582192:0:7778:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788179061.582220:0:7778:0:(import.c:65:import_set_state_nolock()) ffff9bc9359e2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788179061.582287:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f82c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:176e2bf4-b5b0-4c8a-ad1b-45962a669671+6:2353:x1875041450995072:12345-192.168.202.2@tcp:8:mount.lustre.0 Request processed in 452us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179061.582309:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:3.0:1788179061.582339:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:3.0:1788179061.582344:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1875041450995200:12345-192.168.202.2@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788179061.582361:0:7778:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 176e2bf4-b5b0-4c8a-ad1b-45962a669671@192.168.202.2@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:3.0:1788179061.582376:0:7778:0:(genops.c:1407:class_connect()) connect: client 176e2bf4-b5b0-4c8a-ad1b-45962a669671, cookie 0xaa4c98508c498ac6 00002000:00100000:3.0:1788179061.582381:0:7778:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 176e2bf4-b5b0-4c8a-ad1b-45962a669671/ffff9bc9359e7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211371b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788179061.582387:0:7778:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788179061.582513:0:7778:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788179061.586535:0:7778:0:(import.c:65:import_set_state_nolock()) ffff9bc9359e3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788179061.586635:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:176e2bf4-b5b0-4c8a-ad1b-45962a669671+6:2353:x1875041450995200:12345-192.168.202.2@tcp:8:mount.lustre.0 Request processed in 4282us (5031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179061.586647:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:1.0:1788179061.598702:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179061.598803:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450995328 00000100:00100000:2.0:1788179061.598814:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450995328 00000100:00100000:2.0:1788179061.598903:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:2.0:1788179061.598926:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:176e2bf4-b5b0-4c8a-ad1b-45962a669671+6:8095:x1875041450995328:12345-192.168.202.2@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788179061.599167:0:5799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1788179061.599302:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:176e2bf4-b5b0-4c8a-ad1b-45962a669671+6:8095:x1875041450995328:12345-192.168.202.2@tcp:33:mount.lustre.0 Request processed in 378us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179061.599311:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 1 00010000:00010000:2.0:1788179062.020141:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179063.043249:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788179063.051125:0:6618:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 176e2bf4-b5b0-4c8a-ad1b-45962a669671 00000001:00100000:2.0:1788179063.577441:0:7496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 176e2bf4-b5b0-4c8a-ad1b-45962a669671 00010000:00010000:0.0:1788179064.066262:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179064.518232:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788179064.518261:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b5a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041471999488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788179064.518712:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179064.518783:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471999488 00000100:00100000:0.0:1788179064.518791:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471999488 00000100:00100000:0.0:1788179064.519380:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788179064.519392:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041471999488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788179064.519433:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788179064.519485:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041471999488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179064.520701:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788179064.520777:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93b5a9c00 x1875041471999488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179080 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788179064.521235:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788179064.521719:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b5a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041471999488:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788179064.598651:0:5818:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 176e2bf4-b5b0-4c8a-ad1b-45962a669671 00010000:00010000:2.0:1788179065.088005:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788179065.536123:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875041471999872:0@lo:400:kworker.0 00000100:00100000:2.0:1788179065.536218:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179065.536280:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788179065.536287:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875041471999744:0@lo:400:kworker.0 00000100:00100000:2.0:1788179065.536309:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179065.536370:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472000256:0@lo:400:kworker.0 00000100:00100000:2.0:1788179065.536397:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179065.536446:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471999872 00000100:00100000:2.0:1788179065.536453:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471999872 00000100:00100000:2.0:1788179065.536513:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471999744 00000100:00100000:2.0:1788179065.536516:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471999744 00000100:00100000:2.0:1788179065.536539:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788179065.536547:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875041471999872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179065.536608:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875041471999872:12345-0@lo:400:kworker.0 Request processed in 62us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179065.536615:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788179065.536640:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788179065.536646:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875041471999744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179065.536676:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875041471999744:12345-0@lo:400:kworker.0 Request processed in 30us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179065.536682:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788179065.536705:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472000256 00000100:00100000:2.0:1788179065.536708:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472000256 00000100:00100000:2.0:1788179065.536736:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788179065.536743:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472000256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179065.536772:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472000256:12345-0@lo:400:kworker.0 Request processed in 30us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179065.536778:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788179065.536792:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788179065.536797:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788179065.536834:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875041471999744:0@lo:400:kworker.0 00010000:00080000:2.0:1788179065.536866:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8ef800 x1875041472000256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179065.536879:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472000256:0@lo:400:kworker.0 00000100:00100000:2.0:1788179065.536890:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875041471999872:0@lo:400:kworker.0 00000100:00100000:0.0:1788179065.537310:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471999616:0@lo:400:kworker.0 00000100:00100000:0.0:1788179065.537351:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179065.537378:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041472000128:0@lo:400:kworker.0 00000100:00100000:0.0:1788179065.537401:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179065.537420:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788179065.537439:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472000000:0@lo:400:kworker.0 00000100:00100000:0.0:1788179065.537464:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179065.537506:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041471999616 00000100:00100000:0.0:1788179065.537511:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041471999616 00000100:00100000:0.0:1788179065.537542:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788179065.537548:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:3308:x1875041471999616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179065.537593:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:3308:x1875041471999616:12345-0@lo:400:kworker.0 Request processed in 45us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179065.537599:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788179065.537628:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472000000 00000100:00100000:0.0:1788179065.537633:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472000000 00000100:00100000:0.0:1788179065.537655:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788179065.537661:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472000000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179065.537690:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472000000:12345-0@lo:400:kworker.0 Request processed in 29us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179065.537696:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788179065.537725:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8edc00 x1875041472000000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179065.537751:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472000000:0@lo:400:kworker.0 00000100:00100000:0.0:1788179065.537763:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041471999616:0@lo:400:kworker.0 00000100:00100000:0.0:1788179065.537785:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472000128 00000100:00100000:0.0:1788179065.537788:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472000128 00000100:00100000:0.0:1788179065.537811:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788179065.537816:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041472000128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179065.537865:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041472000128:12345-0@lo:400:kworker.0 Request processed in 32us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179065.537871:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788179065.537894:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041472000128:0@lo:400:kworker.0 00000100:00080000:0.0:1788179065.537919:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788179066.051064:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788179066.051086:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472000384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788179066.051173:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179066.051245:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472000384 00000100:00100000:1.0:1788179066.051253:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472000384 00000100:00100000:1.0:1788179066.051310:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788179066.051321:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472000384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788179066.051355:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788179066.051396:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472000384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179066.051404:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788179066.051455:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93f7f1f80 x1875041472000384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179082 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788179066.051473:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472000384:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788179066.120614:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179067.016449:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179067.016498:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179067.016530:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179067.016548:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179067.016593:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179067.016697:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450995584 00000100:00100000:2.0:1788179067.016706:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450995584 00000100:00100000:2.0:1788179067.016764:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450995712 00000100:00100000:2.0:1788179067.016767:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450995712 00000100:00100000:2.0:1788179067.016785:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 67 00000100:00100000:2.0:1788179067.016794:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2354:x1875041450995584:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788179067.016886:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2354:x1875041450995584:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 93us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179067.016895:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 67 00000100:00100000:2.0:1788179067.016909:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 68 00000100:00100000:2.0:1788179067.016915:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2354:x1875041450995712:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788179067.016937:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2354:x1875041450995712:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 22us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179067.016943:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 68 00000100:00100000:2.0:1788179067.016957:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450995456 00000100:00100000:2.0:1788179067.016970:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450995456 00000100:00100000:2.0:1788179067.016999:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 221 00000100:00100000:2.0:1788179067.017005:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2354:x1875041450995456:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788179067.017025:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2354:x1875041450995456:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 21us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179067.017031:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 221 00000100:00100000:2.0:1788179067.017056:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450995840 00000100:00100000:2.0:1788179067.017059:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450995840 00000100:00100000:2.0:1788179067.017090:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450995968 00000100:00100000:2.0:1788179067.017093:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450995968 00000100:00100000:2.0:1788179067.017109:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:2.0:1788179067.017114:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2354:x1875041450995840:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788179067.017135:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2354:x1875041450995840:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 21us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179067.017140:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:2.0:1788179067.017149:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:2.0:1788179067.017160:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2354:x1875041450995968:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788179067.017183:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2354:x1875041450995968:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 24us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179067.017189:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00080000:1.0:1788179067.019831:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788179067.019841:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788179067.019844:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788179067.136062:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179068.160155:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179069.189033:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179069.632973:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788179069.632995:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472000512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788179069.633062:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179069.633291:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472000512 00000100:00100000:1.0:1788179069.633299:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472000512 00000100:00100000:1.0:1788179069.633357:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788179069.633366:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472000512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788179069.633399:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788179069.633471:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472000512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179069.633478:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788179069.636083:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788179069.636143:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93f7f2d80 x1875041472000512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179085 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179069.636168:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472000512:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788179070.036358:0:10169:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1788179070.209658:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179070.656659:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875041472000896:0@lo:400:kworker.0 00000100:00100000:0.0:1788179070.656725:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179070.656794:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b5ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472001024:0@lo:400:kworker.0 00000100:00100000:3.0:1788179070.656826:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179070.656870:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b5a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041472000640:0@lo:400:kworker.0 00000100:00100000:1.0:1788179070.656909:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179070.656971:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b5a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041472001152:0@lo:400:kworker.0 00000100:00100000:1.0:1788179070.656999:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b5a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041472000768:0@lo:400:kworker.0 00000100:00100000:1.0:1788179070.657030:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472000640 00000100:00100000:1.0:1788179070.657037:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472000640 00000100:00100000:0.0:1788179070.661308:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179070.661342:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472000896 00000100:00100000:0.0:1788179070.661350:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472000896 00000100:00100000:0.0:1788179070.662739:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472001152 00000100:00100000:0.0:1788179070.662750:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472001152 00000100:00100000:0.0:1788179070.662805:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788179070.662815:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875041472000896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179070.662916:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875041472000896:12345-0@lo:400:kworker.0 Request processed in 103us (6190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179070.662923:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788179070.662945:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788179070.662952:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041472001152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179070.663369:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041472001152:12345-0@lo:400:kworker.0 Request processed in 418us (2066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179070.663377:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1788179070.663412:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788179070.663586:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b5a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041472001152:0@lo:400:kworker.0 00000100:00100000:0.0:1788179070.663623:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875041472000896:0@lo:400:kworker.0 00000100:00100000:0.0:1788179070.663658:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179070.663684:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b5abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472001280:0@lo:400:kworker.0 00000100:00100000:0.0:1788179070.663716:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472000768 00000100:00100000:0.0:1788179070.663721:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472000768 00000100:00100000:0.0:1788179070.663744:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788179070.663750:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041472000768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179070.663784:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041472000768:12345-0@lo:400:kworker.0 Request processed in 34us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179070.663790:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788179070.665336:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179070.665389:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788179070.665413:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+19:3308:x1875041472000640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179070.665496:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+19:3308:x1875041472000640:12345-0@lo:400:kworker.0 Request processed in 89us (8586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179070.665502:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788179070.665694:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b5a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041472000640:0@lo:400:kworker.0 00000100:00100000:2.0:1788179070.673644:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472001024 00000100:00100000:2.0:1788179070.673662:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472001024 00000100:00100000:2.0:1788179070.673740:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788179070.673750:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472001024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179070.673845:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472001024:12345-0@lo:400:kworker.0 Request processed in 96us (17016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179070.673868:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788179070.673990:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93b5ab480 x1875041472001024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179070.674007:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b5ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472001024:0@lo:400:kworker.0 00000100:00100000:0.0:1788179070.676156:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b5a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041472000768:0@lo:400:kworker.0 00000100:00100000:2.0:1788179070.676322:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472001280 00000100:00100000:2.0:1788179070.676330:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472001280 00000100:00100000:2.0:1788179070.676667:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788179070.676678:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472001280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179070.676756:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472001280:12345-0@lo:400:kworker.0 Request processed in 81us (11425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179070.676764:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788179070.676830:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93b5abb80 x1875041472001280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788179070.676842:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b5abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472001280:0@lo:400:kworker.0 00000100:00080000:0.0:1788179070.677253:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788179071.168204:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472001408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788179071.168274:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179071.168398:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472001408 00000100:00100000:1.0:1788179071.168407:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472001408 00000100:00100000:1.0:1788179071.168466:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788179071.168476:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472001408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788179071.168513:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788179071.168572:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472001408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179071.168579:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788179071.168811:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93f7f0700 x1875041472001408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179087 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179071.168832:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472001408:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788179071.232353:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179072.138801:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179072.138886:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179072.138920:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179072.138951:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179072.138978:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179072.139004:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450996352 00000100:00100000:0.0:1788179072.139014:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450996352 00000100:00100000:0.0:1788179072.139069:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450996224 00000100:00100000:0.0:1788179072.139072:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450996224 00000100:00100000:0.0:1788179072.139110:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 72 00000100:00100000:0.0:1788179072.139122:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2356:x1875041450996352:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179072.139211:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2356:x1875041450996352:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 91us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179072.139218:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 72 00000100:00100000:0.0:1788179072.139239:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 73 00000100:00100000:0.0:1788179072.139245:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2356:x1875041450996224:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179072.139270:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2356:x1875041450996224:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 25us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179072.139276:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 73 00000100:00100000:0.0:1788179072.139310:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450996608 00000100:00100000:0.0:1788179072.139314:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450996608 00000100:00100000:0.0:1788179072.139338:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450996480 00000100:00100000:0.0:1788179072.139341:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450996480 00000100:00100000:0.0:1788179072.139361:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:0.0:1788179072.139367:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a4a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2356:x1875041450996608:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179072.139394:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a4a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2356:x1875041450996608:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 27us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179072.139401:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:0.0:1788179072.139588:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:0.0:1788179072.139595:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2356:x1875041450996480:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179072.139619:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2356:x1875041450996480:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 25us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179072.139625:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00080000:0.0:1788179072.139642:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788179072.139645:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788179072.139648:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788179072.140006:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450996096 00000100:00100000:2.0:1788179072.140012:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450996096 00000100:00100000:2.0:1788179072.140052:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 223 00000100:00100000:2.0:1788179072.140059:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2357:x1875041450996096:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788179072.140105:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2357:x1875041450996096:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 46us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179072.140123:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 223 00010000:00010000:0.0:1788179072.256033:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179073.280169:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179074.306807:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179074.762667:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788179074.762695:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f7f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472001536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788179074.762777:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179074.762950:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472001536 00000100:00100000:1.0:1788179074.762968:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472001536 00000100:00100000:1.0:1788179074.763058:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788179074.763067:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472001536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788179074.763108:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788179074.763156:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472001536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179074.763162:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1788179074.763319:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788179074.763356:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93f7f0000 x1875041472001536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179090 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179074.763376:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f7f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472001536:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788179075.335266:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788179075.779561:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788179075.779654:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041472001792:0@lo:400:kworker.0 00000100:00100000:3.0:1788179075.779729:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179075.779881:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472001792 00000100:00100000:0.0:1788179075.779903:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472001792 00000100:00100000:0.0:1788179075.779952:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788179075.779960:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041472001792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179075.782534:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472001664:0@lo:400:kworker.0 00000100:00100000:2.0:1788179075.782617:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179075.782686:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472001664 00000100:00100000:2.0:1788179075.782694:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472001664 00000100:00100000:2.0:1788179075.782736:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788179075.782744:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:3307:x1875041472001664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179075.782794:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:3307:x1875041472001664:12345-0@lo:400:kworker.0 Request processed in 51us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179075.782802:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788179075.782879:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472001664:0@lo:400:kworker.0 00000100:00100000:2.0:1788179075.782939:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f7f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875041472001920:0@lo:400:kworker.0 00000100:00100000:2.0:1788179075.782969:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179075.783012:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472001920 00000100:00100000:2.0:1788179075.783016:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472001920 00000100:00100000:2.0:1788179075.783054:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788179075.783061:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875041472001920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179075.783095:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875041472001920:12345-0@lo:400:kworker.0 Request processed in 35us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179075.783101:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788179075.783127:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f7f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875041472001920:0@lo:400:kworker.0 00000100:00080000:2.0:1788179075.783148:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788179075.784538:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788179075.784554:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472002048:0@lo:400:kworker.0 00000100:00100000:1.0:1788179075.784608:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179075.784649:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472002048 00000100:00100000:1.0:1788179075.784655:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472002048 00000100:00100000:1.0:1788179075.784697:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788179075.784706:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472002048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179075.784752:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472002048:12345-0@lo:400:kworker.0 Request processed in 47us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179075.784758:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1788179075.784796:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93f7f3100 x1875041472002048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788179075.784808:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472002048:0@lo:400:kworker.0 00000100:00100000:1.0:1788179075.784837:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041472002176:0@lo:400:kworker.0 00000100:00100000:1.0:1788179075.784877:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179075.785121:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041472001792:12345-0@lo:400:kworker.0 Request processed in 5160us (5390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179075.785130:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788179075.785149:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472002176 00000100:00100000:0.0:1788179075.785153:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472002176 00000100:00100000:0.0:1788179075.785218:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788179075.785225:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041472002176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179075.785263:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041472002176:12345-0@lo:400:kworker.0 Request processed in 38us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179075.785268:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788179075.785294:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041472002176:0@lo:400:kworker.0 00000100:00080000:1.0:1788179075.785504:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788179075.785556:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788179075.785567:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f7f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472002304:0@lo:400:kworker.0 00000100:00100000:2.0:1788179075.785610:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179075.785732:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472002304 00000100:00100000:0.0:1788179075.785737:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472002304 00000100:00100000:0.0:1788179075.785782:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788179075.785789:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472002304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179075.785826:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472002304:12345-0@lo:400:kworker.0 Request processed in 37us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179075.785832:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788179075.785925:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93f7f0e00 x1875041472002304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179075.785935:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f7f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472002304:0@lo:400:kworker.0 00000100:00080000:1.0:1788179075.786569:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788179075.786640:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041472001792:0@lo:400:kworker.0 00000100:00100000:3.0:1788179076.291511:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788179076.291534:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472002432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788179076.291599:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179076.293360:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472002432 00000100:00100000:1.0:1788179076.293382:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472002432 00000100:00100000:1.0:1788179076.293445:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788179076.293455:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472002432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788179076.293523:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788179076.293607:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472002432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (2007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179076.293615:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788179076.293776:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93f7f1180 x1875041472002432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179092 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179076.293807:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472002432:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788179076.356989:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179077.261217:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179077.261790:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179077.261829:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179077.261881:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179077.261906:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179077.261939:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450997248 00000100:00100000:0.0:1788179077.261956:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450997248 00000100:00100000:0.0:1788179077.262013:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450997120 00000100:00100000:0.0:1788179077.262016:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450997120 00000100:00100000:0.0:1788179077.262039:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:0.0:1788179077.262066:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2354:x1875041450997248:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179077.262141:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2354:x1875041450997248:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 79us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179077.262149:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:0.0:1788179077.262169:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:0.0:1788179077.262175:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2354:x1875041450997120:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179077.262201:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2354:x1875041450997120:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 26us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179077.262207:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:0.0:1788179077.262227:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450996992 00000100:00100000:0.0:1788179077.262230:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450996992 00000100:00100000:0.0:1788179077.262254:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450996864 00000100:00100000:0.0:1788179077.262257:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450996864 00000100:00100000:0.0:1788179077.262276:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 77 00000100:00100000:0.0:1788179077.262283:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2354:x1875041450996992:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179077.262310:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2354:x1875041450996992:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 28us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179077.262316:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 77 00000100:00100000:0.0:1788179077.262328:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 78 00000100:00100000:0.0:1788179077.262333:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2354:x1875041450996864:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179077.262354:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2354:x1875041450996864:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 21us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179077.262767:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 78 00000100:00080000:0.0:1788179077.262795:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788179077.262800:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788179077.262802:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788179077.266332:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450996736 00000100:00100000:2.0:1788179077.266348:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450996736 00000100:00100000:2.0:1788179077.266444:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 225 00000100:00100000:2.0:1788179077.266468:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2354:x1875041450996736:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788179077.266818:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2354:x1875041450996736:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 362us (5608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179077.266829:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 225 00010000:00010000:0.0:1788179077.376183:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179078.406004:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179079.424194:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788179079.872125:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788179079.872146:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9359b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472002560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788179079.872210:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179079.872278:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472002560 00000100:00100000:2.0:1788179079.872286:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472002560 00000100:00100000:2.0:1788179079.872342:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788179079.872348:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472002560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788179079.872382:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179079.872427:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472002560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179079.872445:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1788179079.872466:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788179079.872490:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc9359b8e00 x1875041472002560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179079.872505:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9359b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472002560:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788179080.448134:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179080.896781:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f6dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041472002816:0@lo:400:kworker.0 00000100:00100000:3.0:1788179080.896872:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179080.896923:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472003328:0@lo:400:kworker.0 00000100:00100000:3.0:1788179080.896950:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179080.896994:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788179080.897001:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041472002944:0@lo:400:kworker.0 00000100:00100000:3.0:1788179080.897024:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179080.897069:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472002816 00000100:00100000:3.0:1788179080.897076:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472002816 00000100:00100000:3.0:1788179080.897119:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472002944 00000100:00100000:3.0:1788179080.897122:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472002944 00000100:00100000:3.0:1788179080.897153:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788179080.897162:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041472002816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179080.897214:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041472002816:12345-0@lo:400:kworker.0 Request processed in 52us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179080.897221:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788179080.897240:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788179080.897247:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041472002944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179080.897273:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041472002944:12345-0@lo:400:kworker.0 Request processed in 27us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179080.897279:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788179080.897297:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472003328 00000100:00100000:3.0:1788179080.897300:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472003328 00000100:00100000:3.0:1788179080.897327:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788179080.897333:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472003328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179080.897763:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472003328:12345-0@lo:400:kworker.0 Request processed in 429us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179080.897771:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1788179080.897796:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788179080.897801:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788179080.897840:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041472002944:0@lo:400:kworker.0 00000100:00100000:3.0:1788179080.897883:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f6dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041472002816:0@lo:400:kworker.0 00010000:00080000:3.0:1788179080.897898:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc9358fa680 x1875041472003328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179080.897923:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472003328:0@lo:400:kworker.0 00000100:00100000:1.0:1788179080.898066:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472003072:0@lo:400:kworker.0 00000100:00100000:1.0:1788179080.898098:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179080.898131:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788179080.898137:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f6dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472002688:0@lo:400:kworker.0 00000100:00100000:1.0:1788179080.898162:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179080.898182:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041472003200:0@lo:400:kworker.0 00000100:00100000:1.0:1788179080.898202:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179080.898345:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472002688 00000100:00100000:2.0:1788179080.898351:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472002688 00000100:00100000:2.0:1788179080.898386:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788179080.898393:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:3307:x1875041472002688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179080.898447:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:3307:x1875041472002688:12345-0@lo:400:kworker.0 Request processed in 55us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179080.898454:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788179080.898491:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f6dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472002688:0@lo:400:kworker.0 00000100:00100000:3.0:1788179080.898602:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472003072 00000100:00100000:3.0:1788179080.898607:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472003072 00000100:00100000:3.0:1788179080.898639:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788179080.898646:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472003072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179080.898680:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472003072:12345-0@lo:400:kworker.0 Request processed in 36us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179080.898686:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788179080.898701:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472003200 00000100:00100000:3.0:1788179080.898705:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472003200 00000100:00100000:3.0:1788179080.898729:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788179080.898734:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875041472003200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179080.898760:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875041472003200:12345-0@lo:400:kworker.0 Request processed in 26us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179080.898765:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1788179080.898780:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788179080.899143:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041472003200:0@lo:400:kworker.0 00010000:00080000:2.0:1788179080.899153:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc9358fa300 x1875041472003072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179080.899162:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472003072:0@lo:400:kworker.0 00000100:00100000:3.0:1788179081.408740:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472003456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788179081.408811:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179081.408934:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472003456 00000100:00100000:0.0:1788179081.408941:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472003456 00000100:00100000:0.0:1788179081.408986:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788179081.408995:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472003456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788179081.409030:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788179081.409080:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472003456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179081.409087:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788179081.409124:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc910b9f100 x1875041472003456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179097 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179081.409138:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472003456:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788179081.475971:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788179082.376151:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179082.376204:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179082.376235:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179082.376911:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450997504 00000100:00100000:3.0:1788179082.376923:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450997504 00000100:00100000:3.0:1788179082.377002:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450997632 00000100:00100000:3.0:1788179082.377006:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450997632 00000100:00100000:2.0:1788179082.377011:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179082.377042:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 82 00000100:00100000:3.0:1788179082.377054:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2354:x1875041450997504:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788179082.377109:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00080000:1.0:1788179082.377222:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788179082.378905:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2354:x1875041450997504:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 1843us (2765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179082.378933:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 82 00000100:00100000:3.0:1788179082.378968:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 83 00000100:00100000:3.0:1788179082.378980:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2354:x1875041450997632:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788179082.379050:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2354:x1875041450997632:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 74us (2814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179082.379058:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 83 00000100:00100000:2.0:1788179082.379124:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450997376 00000100:00100000:2.0:1788179082.379133:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450997376 00000100:00100000:2.0:1788179082.379187:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 227 00000100:00100000:2.0:1788179082.379195:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2354:x1875041450997376:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788179082.379233:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2354:x1875041450997376:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 39us (3028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179082.379239:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 227 00000100:00100000:3.0:1788179082.380112:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450997760 00000100:00100000:3.0:1788179082.380120:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450997760 00000100:00100000:3.0:1788179082.380159:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450997888 00000100:00100000:3.0:1788179082.380162:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450997888 00000100:00100000:3.0:1788179082.380183:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:3.0:1788179082.380190:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2353:x1875041450997760:12345-192.168.202.2@tcp:9:kworker.0 00000020:00000080:3.0:1788179082.380212:0:6591:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c498abf 00000100:00080000:3.0:1788179082.380221:0:6591:0:(import.c:65:import_set_state_nolock()) ffff9bc9359e2000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788179082.380537:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:2.0:1788179082.380548:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2353:x1875041450997888:12345-192.168.202.2@tcp:9:kworker.0 00000020:00000080:2.0:1788179082.380564:0:6589:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c498ac6 00000100:00080000:2.0:1788179082.380570:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9bc9359e3800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788179082.380598:0:6589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000001:00000004:3.0:1788179082.380778:0:6591:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788179082.380951:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:176e2bf4-b5b0-4c8a-ad1b-45962a669671+2:2353:x1875041450997888:12345-192.168.202.2@tcp:9:kworker.0 Request processed in 406us (3842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179082.380960:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:3.0:1788179082.381223:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:176e2bf4-b5b0-4c8a-ad1b-45962a669671+2:2353:x1875041450997760:12345-192.168.202.2@tcp:9:kworker.0 Request processed in 1032us (4214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179082.381230:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00080000:3.0:1788179082.381719:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788179082.381726:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788179082.381741:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179082.381746:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179082.497478:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179083.524336:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788179083.535561:0:6618:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 176e2bf4-b5b0-4c8a-ad1b-45962a669671 00000020:00000080:3.0:1788179083.535570:0:6618:0:(genops.c:907:class_export_put()) final put ffff9bc9359e5000/176e2bf4-b5b0-4c8a-ad1b-45962a669671 00000020:00000080:3.0:1788179083.535601:0:37:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc9359e5000/176e2bf4-b5b0-4c8a-ad1b-45962a669671 for lustre-OST0000 00000020:00000080:3.0:1788179083.536055:0:37:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9bc9359e2000 for lustre-OST0000 00000001:00100000:2.0:1788179084.065417:0:7496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 176e2bf4-b5b0-4c8a-ad1b-45962a669671 00000020:00000080:2.0:1788179084.065426:0:7496:0:(genops.c:907:class_export_put()) final put ffff9bc9359e7000/176e2bf4-b5b0-4c8a-ad1b-45962a669671 00000020:00000080:0.0:1788179084.065584:0:471:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc9359e7000/176e2bf4-b5b0-4c8a-ad1b-45962a669671 for lustre-OST0001 00000020:00000080:0.0:1788179084.065631:0:471:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9bc9359e3800 for lustre-OST0001 00010000:00010000:3.0:1788179084.544176:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788179084.996978:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472003584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788179084.997051:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179084.997143:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472003584 00000100:00100000:3.0:1788179084.997150:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472003584 00000100:00100000:3.0:1788179084.997211:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788179084.997221:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472003584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788179084.997257:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788179085.003517:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472003584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6289us (6456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179085.003531:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1788179085.003563:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788179085.006566:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc910b9f100 x1875041472003584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179085.006597:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472003584:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788179085.568095:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179086.020540:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041472003840:0@lo:400:kworker.0 00000100:00100000:1.0:1788179086.020625:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179086.020683:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472004352:0@lo:400:kworker.0 00000100:00100000:1.0:1788179086.020710:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179086.020742:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788179086.020748:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f7f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041472003968:0@lo:400:kworker.0 00000100:00100000:1.0:1788179086.020769:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179086.020799:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472003840 00000100:00100000:1.0:1788179086.020806:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472003840 00000100:00100000:1.0:1788179086.020871:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472003968 00000100:00100000:1.0:1788179086.020875:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472003968 00000100:00100000:1.0:1788179086.020908:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788179086.020918:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041472003840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179086.020996:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041472003840:12345-0@lo:400:kworker.0 Request processed in 78us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179086.021003:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788179086.021020:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788179086.021026:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041472003968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179086.021053:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041472003968:12345-0@lo:400:kworker.0 Request processed in 28us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179086.021059:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788179086.021076:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472004352 00000100:00100000:1.0:1788179086.021080:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472004352 00000100:00100000:1.0:1788179086.021109:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788179086.021116:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472004352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179086.021144:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472004352:12345-0@lo:400:kworker.0 Request processed in 28us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179086.021150:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1788179086.021170:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788179086.021174:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788179086.021207:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f7f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041472003968:0@lo:400:kworker.0 00000100:00100000:1.0:1788179086.021218:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041472003840:0@lo:400:kworker.0 00010000:00080000:1.0:1788179086.021230:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93f7f0380 x1875041472004352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788179086.021239:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472004352:0@lo:400:kworker.0 00000100:00100000:0.0:1788179086.021529:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472004096:0@lo:400:kworker.0 00000100:00100000:0.0:1788179086.021564:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179086.021586:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788179086.021591:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f7f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472003712:0@lo:400:kworker.0 00000100:00100000:0.0:1788179086.021615:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179086.021638:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f7f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041472004224:0@lo:400:kworker.0 00000100:00100000:0.0:1788179086.021670:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179086.021701:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472004096 00000100:00100000:0.0:1788179086.021706:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472004096 00000100:00100000:0.0:1788179086.021738:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788179086.021745:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472004096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179086.021779:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472004096:12345-0@lo:400:kworker.0 Request processed in 36us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179086.021785:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788179086.021805:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472003712 00000100:00100000:0.0:1788179086.021808:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472003712 00000100:00100000:0.0:1788179086.021829:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788179086.021835:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:3307:x1875041472003712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179086.021889:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:3307:x1875041472003712:12345-0@lo:400:kworker.0 Request processed in 55us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179086.021895:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00080000:0.0:1788179086.021924:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788179086.021940:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f7f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472003712:0@lo:400:kworker.0 00010000:00080000:0.0:1788179086.021950:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93f7f2a00 x1875041472004096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179086.021958:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472004096:0@lo:400:kworker.0 00000100:00100000:0.0:1788179086.021979:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472004224 00000100:00100000:0.0:1788179086.021982:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472004224 00000100:00100000:0.0:1788179086.022008:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788179086.022014:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875041472004224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179086.022046:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875041472004224:12345-0@lo:400:kworker.0 Request processed in 32us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179086.022058:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1788179086.022073:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788179086.022088:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f7f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041472004224:0@lo:400:kworker.0 00000100:00100000:0.0:1788179086.536314:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9359bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472004480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788179086.536396:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179086.536518:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472004480 00000100:00100000:0.0:1788179086.536526:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472004480 00000100:00100000:0.0:1788179086.536611:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788179086.536621:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472004480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788179086.536656:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788179086.536696:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472004480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179086.536714:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1788179086.537070:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc9359bb800 x1875041472004480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179102 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179086.537090:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9359bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472004480:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788179086.592008:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788179086.642511:0:10871:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1788179087.500514:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179087.500561:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179087.500596:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179087.500675:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450998272 00000100:00100000:0.0:1788179087.500690:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450998272 00000100:00100000:0.0:1788179087.500779:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450998144 00000100:00100000:0.0:1788179087.500782:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450998144 00000100:00100000:0.0:1788179087.500803:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 87 00000100:00100000:0.0:1788179087.500812:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2354:x1875041450998272:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179087.500919:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2354:x1875041450998272:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 108us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179087.500946:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 87 00000100:00100000:0.0:1788179087.500966:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 88 00000100:00100000:0.0:1788179087.500973:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2354:x1875041450998144:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179087.501001:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2354:x1875041450998144:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 29us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179087.501007:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 88 00000100:00080000:2.0:1788179087.501337:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788179087.501768:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450998016 00000100:00100000:3.0:1788179087.501774:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450998016 00000100:00100000:3.0:1788179087.501814:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 229 00000100:00100000:3.0:1788179087.501820:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2354:x1875041450998016:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788179087.501886:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2354:x1875041450998016:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 66us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179087.501893:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 229 00010000:00010000:0.0:1788179087.617061:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179088.641428:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179089.664166:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788179090.084236:0:11020:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda44c8700 20000000:00000080:2.0:1788179090.084256:0:11020:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bc93a5d7000 uarg=0000000000000000 20000000:01000000:2.0:1788179090.084296:0:11020:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788179090.084302:0:11020:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788179090.084308:0:11020:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788179090.085428:0:11021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788179090.085626:0:11020:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788179090.095137:0:11020:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788179090.095468:0:11020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bc9137b5e00/0xaa4c98508c498acd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179090.095491:0:11020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc9137b4400/0xaa4c98508c498a72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ecf expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179090.095501:0:11020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc900030400/0xaa4c98508c498a80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498a79 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179090.095516:0:11020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc92e12dc00/0xaa4c98508c498a8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498a87 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179090.095523:0:11020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc900030600/0xaa4c98508c498a9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498a95 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179090.095530:0:11020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc9136c5000/0xaa4c98508c498ab1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f07 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179090.095538:0:11020:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bc9137b5e00/0xaa4c98508c498acd lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179090.095582:0:11020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc9136c5000/0xaa4c98508c498ab1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f07 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179090.095597:0:11020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bc9136c5000/0xaa4c98508c498ab1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f07 expref: 12 pid: 5790 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179090.095613:0:11020:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358f9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1875041472004608:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788179090.095730:0:11020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc900030600/0xaa4c98508c498a9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c498a95 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179090.095739:0:11020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bc900030600/0xaa4c98508c498a9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c498a95 expref: 18 pid: 5789 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179090.095748:0:11020:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358fb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1875041472004736:0@lo:104: 00000100:00100000:3.0:1788179090.095788:0:11020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788179090.095830:0:11020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc92e12dc00/0xaa4c98508c498a8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c498a87 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179090.095844:0:11020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bc92e12dc00/0xaa4c98508c498a8e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c498a87 expref: 18 pid: 5789 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179090.099304:0:11020:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358fa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1875041472004864:0@lo:104: 00000100:00100000:3.0:1788179090.099387:0:11020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788179090.099463:0:11020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc900030400/0xaa4c98508c498a80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c498a79 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179090.099475:0:11020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bc900030400/0xaa4c98508c498a80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c498a79 expref: 18 pid: 5789 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179090.099484:0:11020:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f6dfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1875041472004992:0@lo:104: 00000100:00100000:3.0:1788179090.099501:0:11020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788179090.099536:0:11020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc9137b4400/0xaa4c98508c498a72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ecf expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179090.099545:0:11020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bc9137b4400/0xaa4c98508c498a72 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ecf expref: 12 pid: 5789 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179090.099555:0:11020:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc907039880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1875041472005120:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788179090.099596:0:11020:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc926544c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788179090.099702:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472004736 00000100:00100000:0.0:1788179090.099709:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472004736 00000100:00100000:0.0:1788179090.099748:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472004864 00000100:00100000:0.0:1788179090.099751:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472004864 00000100:00100000:0.0:1788179090.099759:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472004992 00000100:00100000:0.0:1788179090.099761:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472004992 00000100:00100000:0.0:1788179090.099772:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788179090.099780:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efc6f743-3303-46d5-8807-513b82cac1cc+5:11020:x1875041472004736:12345-0@lo:104: 00010000:00010000:0.0:1788179090.099792:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c000/0xaa4c98508c498a95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498a9c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179090.099862:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788179090.099868:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efc6f743-3303-46d5-8807-513b82cac1cc+5:11020:x1875041472004736:12345-0@lo:104: Request processed in 89us (4081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179090.099875:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788179090.099894:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788179090.099899:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efc6f743-3303-46d5-8807-513b82cac1cc+4:11020:x1875041472004864:12345-0@lo:104: 00010000:00010000:0.0:1788179090.099905:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d000/0xaa4c98508c498a87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498a8e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179090.099939:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788179090.099944:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efc6f743-3303-46d5-8807-513b82cac1cc+4:11020:x1875041472004864:12345-0@lo:104: Request processed in 45us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179090.099949:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788179090.099960:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788179090.099965:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efc6f743-3303-46d5-8807-513b82cac1cc+3:11020:x1875041472004992:12345-0@lo:104: 00010000:00010000:0.0:1788179090.099971:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d800/0xaa4c98508c498a79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498a80 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179090.100000:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788179090.100004:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efc6f743-3303-46d5-8807-513b82cac1cc+3:11020:x1875041472004992:12345-0@lo:104: Request processed in 40us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179090.100009:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788179090.100118:0:6605:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788179090.100124:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c000/0xaa4c98508c498a95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498a9c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179090.100131:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92e12c000 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1788179090.100136:0:6605:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c000/0xaa4c98508c498a95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c498a9c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179090.100144:0:6605:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c000/0xaa4c98508c498a95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c498a9c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788179090.100152:0:6605:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c000/0xaa4c98508c498a95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c498a9c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788179090.100157:0:6605:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788179090.100189:0:6605:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c000/0xaa4c98508c498a95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498a9c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179090.100195:0:6605:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788179090.100211:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c000/0xaa4c98508c498a95 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498a9c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179090.100218:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c000/0xaa4c98508c498a95 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498a9c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179090.100230:0:6605:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788179090.100233:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d000/0xaa4c98508c498a87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498a8e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179090.100238:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92e12d000 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1788179090.100241:0:6605:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d000/0xaa4c98508c498a87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c498a8e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179090.100248:0:6605:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d000/0xaa4c98508c498a87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c498a8e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788179090.100254:0:6605:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d000/0xaa4c98508c498a87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c498a8e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788179090.100259:0:6605:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788179090.100268:0:6605:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d000/0xaa4c98508c498a87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498a8e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179090.100273:0:6605:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788179090.100278:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d000/0xaa4c98508c498a87 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498a8e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179090.100293:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d000/0xaa4c98508c498a87 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498a8e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179090.100301:0:6605:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788179090.100304:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d800/0xaa4c98508c498a79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498a80 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179090.100309:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92e12d800 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1788179090.100312:0:6605:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d800/0xaa4c98508c498a79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c498a80 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179090.100319:0:6605:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d800/0xaa4c98508c498a79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c498a80 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788179090.100325:0:6605:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d800/0xaa4c98508c498a79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c498a80 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788179090.100329:0:6605:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788179090.100352:0:6605:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d800/0xaa4c98508c498a79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498a80 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179090.100358:0:6605:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788179090.100369:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d800/0xaa4c98508c498a79 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498a80 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179090.100375:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d800/0xaa4c98508c498a79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498a80 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179090.100388:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179090.100393:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179090.100395:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179090.100401:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179090.100405:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179090.100422:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472005248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788179090.100451:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179090.100467:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788179090.100472:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472005376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788179090.100487:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179090.100505:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788179090.100510:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041472005504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788179090.100527:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179090.100545:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472005248 00000100:00100000:0.0:1788179090.100549:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472005248 00010000:00010000:0.0:1788179090.100564:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc900030600/0xaa4c98508c498a9c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c498a95 expref: 19 pid: 5789 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179090.100576:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472005376 00000100:00100000:0.0:1788179090.100578:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472005376 00010000:00010000:0.0:1788179090.100585:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc92e12dc00/0xaa4c98508c498a8e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c498a87 expref: 20 pid: 5789 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179090.100593:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472005504 00000100:00100000:0.0:1788179090.100595:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472005504 00010000:00010000:0.0:1788179090.100602:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc900030400/0xaa4c98508c498a80 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c498a79 expref: 21 pid: 5789 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179090.100612:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788179090.100617:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc905f65450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+21:3307:x1875041472005248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788179090.100626:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179090.100636:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc900030600/0xaa4c98508c498a9c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c498a95 expref: 21 pid: 5789 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179090.100646:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc900030600/0xaa4c98508c498a9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c498a95 expref: 21 pid: 5789 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179090.100662:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179090.100684:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc905f65450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+21:3307:x1875041472005248:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179090.100690:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788179090.100723:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788179090.100728:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+20:3307:x1875041472005376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788179090.100734:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179090.100737:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc92e12dc00/0xaa4c98508c498a8e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c498a87 expref: 20 pid: 5789 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179090.100745:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc92e12dc00/0xaa4c98508c498a8e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c498a87 expref: 20 pid: 5789 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179090.100754:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179090.100769:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+20:3307:x1875041472005376:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179090.100775:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788179090.100784:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788179090.100789:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+19:3306:x1875041472005504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788179090.100794:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179090.100798:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc900030400/0xaa4c98508c498a80 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c498a79 expref: 19 pid: 5789 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179090.100814:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc900030400/0xaa4c98508c498a80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c498a79 expref: 19 pid: 5789 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179090.100823:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179090.100841:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+19:3306:x1875041472005504:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179090.100866:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788179090.100894:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472005376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788179090.100901:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472005248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788179090.100920:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041472005504:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788179090.101725:0:11020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc900030600/0xaa4c98508c498a9c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c498a95 expref: 18 pid: 5789 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179090.101737:0:11020:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358fb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1875041472004736:0@lo:104: 00010000:00010000:3.0:1788179090.101746:0:11020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc92e12dc00/0xaa4c98508c498a8e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c498a87 expref: 17 pid: 5789 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179090.101764:0:11020:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358fa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1875041472004864:0@lo:104: 00010000:00010000:3.0:1788179090.101774:0:11020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc900030400/0xaa4c98508c498a80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c498a79 expref: 16 pid: 5789 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179090.101781:0:11020:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f6dfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1875041472004992:0@lo:104: 00000100:00100000:2.0:1788179090.105296:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179090.105385:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450998400 00000100:00100000:0.0:1788179090.105394:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450998400 00010000:00010000:0.0:1788179090.105431:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc9136c5000/0xaa4c98508c498ab1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f07 expref: 13 pid: 5790 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179090.105470:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:0.0:1788179090.105479:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2357:x1875041450998400:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179090.105497:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179090.105503:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc9136c5000/0xaa4c98508c498ab1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f07 expref: 13 pid: 5790 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179090.105515:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc9136c5000/0xaa4c98508c498ab1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f07 expref: 13 pid: 5790 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179090.105534:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179090.105587:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2357:x1875041450998400:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 109us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179090.105608:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 28 00010000:00010000:3.0:1788179090.107026:0:11020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc9136c5000/0xaa4c98508c498ab1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f07 expref: 12 pid: 5790 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179090.107058:0:11020:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358f9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1875041472004608:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788179090.107071:0:11020:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc907039880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1875041472005120:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788179090.107108:0:11020:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bc9137b5e00/0xaa4c98508c498acd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179090.107407:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179090.107501:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450998528 00000100:00100000:2.0:1788179090.107509:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450998528 00010000:00010000:2.0:1788179090.107539:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc9137b4400/0xaa4c98508c498a72 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ecf expref: 12 pid: 5789 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179090.107571:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:2.0:1788179090.107579:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+12:2356:x1875041450998528:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788179090.107592:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179090.107597:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc9137b4400/0xaa4c98508c498a72 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ecf expref: 12 pid: 5789 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179090.107606:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc9137b4400/0xaa4c98508c498a72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ecf expref: 12 pid: 5789 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179090.107622:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc9137b4400/0xaa4c98508c498a72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ecf expref: 12 pid: 5789 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179090.107636:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bc9137b5e00/0xaa4c98508c498acd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179090.107645:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9137b5e00/0xaa4c98508c498acd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179090.107659:0:5783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bc9137b5e00/0xaa4c98508c498acd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179090.107795:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bc9137b5e00/0xaa4c98508c498acd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179090.107805:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bc9137b5e00/0xaa4c98508c498acd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179090.107824:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bc9137b5e00/0xaa4c98508c498acd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179090.107830:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5e00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:2.0:1788179090.107834:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bc9137b5e00/0xaa4c98508c498acd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179090.107842:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bc9137b5e00/0xaa4c98508c498acd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179090.107986:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bc9137b5e00/0xaa4c98508c498acd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179090.107996:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788179090.108151:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+11:2356:x1875041450998528:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 571us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179090.108158:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 29 00010000:00010000:3.0:1788179090.109195:0:11020:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bc9137b5e00/0xaa4c98508c498acd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179090.109209:0:11020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bc9137b5e00/0xaa4c98508c498acd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179090.109216:0:11020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc9137b5e00/0xaa4c98508c498acd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179090.113297:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472005632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788179090.113385:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179090.113568:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472005632 00000100:00100000:2.0:1788179090.113577:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472005632 00000100:00100000:2.0:1788179090.113634:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788179090.113645:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472005632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788179090.113692:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179090.113740:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472005632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179090.113748:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1788179090.113771:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788179090.113804:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e0c6a00 x1875041472005632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179106 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179090.113842:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472005632:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788179090.694169:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788179091.136789:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9359b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875041472005888:0@lo:400:kworker.0 00000100:00100000:2.0:1788179091.136898:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179091.136904:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9359b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472005760:0@lo:400:kworker.0 00000100:00100000:3.0:1788179091.136938:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179091.136947:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472006400:0@lo:400:kworker.0 00000100:00100000:3.0:1788179091.136969:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9359bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041472006272:0@lo:400:kworker.0 00000100:00100000:2.0:1788179091.136971:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179091.136990:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179091.137008:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9359baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041472006016:0@lo:400:kworker.0 00000100:00100000:2.0:1788179091.137031:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179091.137058:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788179091.137064:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9359bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472006144:0@lo:400:kworker.0 00000100:00100000:2.0:1788179091.137085:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179091.137085:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472005760 00000100:00100000:0.0:1788179091.137093:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472005760 00000100:00100000:2.0:1788179091.137113:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472005888 00000100:00100000:2.0:1788179091.137116:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472005888 00000100:00100000:2.0:1788179091.137147:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472006272 00000100:00100000:2.0:1788179091.137150:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472006272 00000100:00100000:0.0:1788179091.137151:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788179091.137160:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+16:3307:x1875041472005760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179091.137169:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472006016 00000100:00100000:2.0:1788179091.137172:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472006016 00000100:00100000:2.0:1788179091.137185:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788179091.137190:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875041472005888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179091.137211:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+16:3307:x1875041472005760:12345-0@lo:400:kworker.0 Request processed in 52us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179091.137218:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788179091.137220:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875041472005888:12345-0@lo:400:kworker.0 Request processed in 30us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179091.137225:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788179091.137238:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788179091.137243:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875041472006272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179091.137255:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788179091.137260:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041472006016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179091.137265:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875041472006272:12345-0@lo:400:kworker.0 Request processed in 23us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179091.137280:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788179091.137288:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041472006016:12345-0@lo:400:kworker.0 Request processed in 28us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179091.137293:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788179091.137297:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472006400 00000100:00100000:2.0:1788179091.137300:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472006400 00000100:00100000:2.0:1788179091.137323:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472006144 00000100:00100000:2.0:1788179091.137337:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472006144 00000100:00100000:0.0:1788179091.137337:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9359b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472005760:0@lo:400:kworker.0 00000100:00100000:0.0:1788179091.137352:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9359bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041472006272:0@lo:400:kworker.0 00000100:00100000:2.0:1788179091.137356:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788179091.137361:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472006400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179091.137390:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472006400:12345-0@lo:400:kworker.0 Request processed in 29us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179091.137396:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788179091.137407:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788179091.137412:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472006144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179091.137438:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472006144:12345-0@lo:400:kworker.0 Request processed in 26us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179091.137444:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1788179091.137468:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788179091.137472:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788179091.137496:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc9359bb800 x1875041472006144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179091.137507:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9359bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472006144:0@lo:400:kworker.0 00000100:00100000:2.0:1788179091.137531:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9359baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041472006016:0@lo:400:kworker.0 00000100:00100000:2.0:1788179091.137552:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9359b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875041472005888:0@lo:400:kworker.0 00010000:00080000:2.0:1788179091.137561:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8ef100 x1875041472006400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179091.137567:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472006400:0@lo:400:kworker.0 00000100:00100000:2.0:1788179091.208031:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179091.208136:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450998656 00000100:00100000:0.0:1788179091.208148:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450998656 00000100:00100000:0.0:1788179091.208210:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 231 00000100:00100000:0.0:1788179091.208221:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+11:5572:x1875041450998656:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788179091.208248:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179091.208293:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc900030400/0xaa4c98508c498ad4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x34c7c42474661f31 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179091.208333:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc900030400/0xaa4c98508c498ad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f31 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179091.208346:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc900030400/0xaa4c98508c498ad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f31 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179091.208355:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc900030400, rc 0) 00000100:00100000:0.0:1788179091.208418:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+12:5572:x1875041450998656:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 Request processed in 197us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179091.208425:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 231 00000100:00100000:2.0:1788179091.213181:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179091.213376:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450998784 00000100:00100000:0.0:1788179091.213388:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450998784 00000100:00100000:0.0:1788179091.213447:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 232 00000100:00100000:0.0:1788179091.213458:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+12:5572:x1875041450998784:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788179091.213748:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+12:5572:x1875041450998784:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 Request processed in 291us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179091.213757:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 232 00000100:00100000:1.0:1788179091.215675:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179091.215775:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450998912 00000100:00100000:2.0:1788179091.215783:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450998912 00000100:00100000:2.0:1788179091.215840:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 233 00000100:00100000:2.0:1788179091.215897:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+12:5572:x1875041450998912:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788179091.216102:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+12:5572:x1875041450998912:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 Request processed in 252us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179091.216110:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 233 00000100:00100000:2.0:1788179091.230172:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179091.230680:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450999040 00000100:00100000:0.0:1788179091.230690:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450999040 00000100:00100000:0.0:1788179091.230747:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 234 00000100:00100000:0.0:1788179091.230757:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+12:5572:x1875041450999040:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788179091.230784:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179091.230802:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc900030600/0xaa4c98508c498adb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x34c7c42474661f38 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179091.230883:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc900030600/0xaa4c98508c498adb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f38 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179091.230896:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc900030600/0xaa4c98508c498adb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f38 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179091.230906:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc900030600, rc 0) 00000100:00100000:0.0:1788179091.230959:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:5572:x1875041450999040:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 Request processed in 202us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179091.230966:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 234 00000100:00100000:3.0:1788179091.233547:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179091.233882:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450999168 00000100:00100000:0.0:1788179091.233892:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450999168 00000100:00100000:0.0:1788179091.233950:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 235 00000100:00100000:0.0:1788179091.233960:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:5572:x1875041450999168:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788179091.234256:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:5572:x1875041450999168:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 Request processed in 296us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179091.234265:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 235 00000100:00100000:1.0:1788179091.261246:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179091.261406:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450999296 00000100:00100000:2.0:1788179091.261418:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450999296 00000100:00100000:2.0:1788179091.261544:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 236 00000100:00100000:2.0:1788179091.261555:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:5572:x1875041450999296:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788179091.262840:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:5572:x1875041450999296:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 Request processed in 1278us (1595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179091.262969:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 236 10000000:01000000:2.0:1788179091.397093:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788179091.397101:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bc902f11000 from 7 10000000:01000000:2.0:1788179091.397106:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788179091.397154:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5800/0xaa4c98508c498ae2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179091.397166:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5800/0xaa4c98508c498ae2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179091.397178:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5800/0xaa4c98508c498ae2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179091.397214:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472006528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788179091.397289:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179091.397343:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9071d3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788179091.397397:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472006528 00000100:00100000:0.0:1788179091.397406:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472006528 00000100:00100000:0.0:1788179091.397472:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788179091.397482:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+16:5793:x1875041472006528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788179091.397497:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179091.397511:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc900031e00/0xaa4c98508c498ae9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c498ae2 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179091.397537:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc900031e00/0xaa4c98508c498ae9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c498ae2 expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179091.397556:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc900031e00/0xaa4c98508c498ae9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498ae2 expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179091.397567:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc900031e00, rc 0) 00000100:00100000:0.0:1788179091.397611:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+17:5793:x1875041472006528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179091.397618:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788179091.397672:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472006528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788179091.397687:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5800/0xaa4c98508c498ae2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498ae9 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179091.397696:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5800/0xaa4c98508c498ae2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498ae9 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179091.397749:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472006656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788179091.397788:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179091.397802:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc902f9b600 going to sleep for 11 seconds 00000100:00100000:0.0:1788179091.397816:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472006656 00000100:00100000:0.0:1788179091.397819:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472006656 00000100:00100000:0.0:1788179091.397841:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788179091.397881:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+17:5793:x1875041472006656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788179091.398103:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+17:5793:x1875041472006656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179091.398110:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788179091.398264:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472006656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788179091.398300:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472006784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788179091.398350:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179091.398371:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc926545000 going to sleep for 11 seconds 00000100:00100000:0.0:1788179091.398381:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472006784 00000100:00100000:0.0:1788179091.398384:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472006784 00000100:00100000:0.0:1788179091.398401:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788179091.398407:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+17:5793:x1875041472006784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788179091.398531:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+17:5793:x1875041472006784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179091.398538:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788179091.398584:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472006784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788179091.413275:0:11044:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788179091.413503:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788179091.413531:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788179091.413544:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5800/0xaa4c98508c498ae2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498ae9 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179091.413557:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5800/0xaa4c98508c498ae2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498ae9 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788179091.413569:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788179091.413571:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bc913608800 from 7 10000000:01000000:3.0:1788179091.413575:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788179091.413613:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c498af0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179091.413620:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c498af0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179091.413631:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c498af0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179091.413655:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc907039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472006912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788179091.413722:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179091.413764:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc926544540 going to sleep for 11 seconds 00000100:00100000:2.0:1788179091.414154:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472006912 00000100:00100000:2.0:1788179091.414162:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472006912 00000100:00100000:2.0:1788179091.414213:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788179091.414222:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+17:5793:x1875041472006912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788179091.414237:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179091.414250:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9136c4200/0xaa4c98508c498af7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c498af0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179091.414272:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9136c4200/0xaa4c98508c498af7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c498af0 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179091.414283:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9136c4200/0xaa4c98508c498af7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498af0 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179091.414291:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c4200, rc 0) 00000100:00100000:2.0:1788179091.414343:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041472006912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179091.414350:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788179091.414560:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc907039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472006912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788179091.414575:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c498af0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498af7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179091.414584:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c498af0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498af7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179091.414655:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc907039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472007040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788179091.414682:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179091.414710:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc926544540 going to sleep for 11 seconds 00000100:00100000:1.0:1788179091.417272:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472007040 00000100:00100000:1.0:1788179091.417293:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472007040 00000100:00100000:1.0:1788179091.417353:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788179091.417363:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041472007040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788179091.417705:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041472007040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 342us (3020us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179091.417713:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788179091.417894:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc907039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472007040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788179091.417947:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc907039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472007168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788179091.417992:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179091.418023:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc926544540 going to sleep for 11 seconds 00000100:00100000:3.0:1788179091.418037:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472007168 00000100:00100000:3.0:1788179091.418041:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472007168 00000100:00100000:3.0:1788179091.418069:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788179091.418077:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041472007168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788179091.418217:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041472007168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179091.418223:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788179091.418256:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc907039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472007168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788179091.418934:0:11046:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788179091.418985:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788179091.419002:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788179091.419013:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c498af0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498af7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179091.419024:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c498af0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498af7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788179091.419035:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788179091.419046:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bc9070e2800 from 7 10000000:01000000:3.0:1788179091.419049:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788179091.419080:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4800/0xaa4c98508c498afe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179091.419088:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4800/0xaa4c98508c498afe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179091.419098:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4800/0xaa4c98508c498afe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179091.419113:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc907039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472007296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788179091.419148:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179091.419168:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc926544c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788179091.419185:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472007296 00000100:00100000:3.0:1788179091.419189:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472007296 00000100:00100000:3.0:1788179091.419217:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788179091.419223:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041472007296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788179091.419233:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179091.419244:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9137b5200/0xaa4c98508c498b05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c498afe expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179091.419263:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9137b5200/0xaa4c98508c498b05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c498afe expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179091.419272:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9137b5200/0xaa4c98508c498b05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498afe expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179091.419281:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b5200, rc 0) 00000100:00100000:3.0:1788179091.419305:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:5793:x1875041472007296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179091.419316:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788179091.419364:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc907039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472007296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788179091.419376:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4800/0xaa4c98508c498afe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498b05 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179091.419385:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4800/0xaa4c98508c498afe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498b05 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179091.419420:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc907039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472007424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788179091.419440:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179091.419451:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc926544c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788179091.419460:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472007424 00000100:00100000:3.0:1788179091.419463:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472007424 00000100:00100000:3.0:1788179091.419478:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788179091.419483:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:5793:x1875041472007424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788179091.419653:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:5793:x1875041472007424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179091.419660:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788179091.419685:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc907039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472007424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788179091.419705:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc907039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472007552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788179091.419733:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179091.419743:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc926544c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788179091.419751:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472007552 00000100:00100000:3.0:1788179091.419754:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472007552 00000100:00100000:3.0:1788179091.419770:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788179091.419781:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:5793:x1875041472007552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788179091.419914:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:5793:x1875041472007552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179091.419920:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788179091.419949:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc907039500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472007552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788179091.440662:0:11047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788179091.441089:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788179091.441111:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788179091.441123:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4800/0xaa4c98508c498afe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498b05 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179091.441136:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4800/0xaa4c98508c498afe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498b05 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179091.650494:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788179091.650517:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472007680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788179091.650582:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179091.650647:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472007680 00000100:00100000:2.0:1788179091.650667:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472007680 00000100:00100000:2.0:1788179091.650724:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788179091.650733:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472007680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788179091.650765:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179091.650809:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472007680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179091.650816:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788179091.650888:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8ed500 x1875041472007680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179107 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179091.650909:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472007680:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788179091.714049:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179092.617099:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179092.617156:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179092.617182:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179092.617211:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450999424 00000100:00100000:0.0:1788179092.617220:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450999424 00000100:00100000:0.0:1788179092.617273:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 246 00000100:00100000:0.0:1788179092.617283:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2354:x1875041450999424:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179092.617373:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2354:x1875041450999424:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 91us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179092.617381:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 246 00000100:00100000:0.0:1788179092.617415:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450999552 00000100:00100000:0.0:1788179092.617419:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450999552 00000100:00100000:0.0:1788179092.617466:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450999680 00000100:00100000:0.0:1788179092.617469:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450999680 00000100:00100000:0.0:1788179092.617491:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 92 00000100:00100000:0.0:1788179092.617498:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2354:x1875041450999552:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179092.617528:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2354:x1875041450999552:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 30us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179092.617534:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 92 00000100:00100000:0.0:1788179092.617548:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 93 00000100:00100000:0.0:1788179092.617553:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2354:x1875041450999680:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179092.617577:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2354:x1875041450999680:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 24us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179092.617583:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 93 00000100:00080000:0.0:1788179092.617601:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788179092.743890:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179093.760654:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179094.784179:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788179095.003275:0:11218:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788179095.233456:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472007808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788179095.233547:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179095.233592:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472007808 00000100:00100000:3.0:1788179095.233601:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472007808 00000100:00100000:3.0:1788179095.233666:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788179095.233678:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472007808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788179095.233738:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788179095.233790:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472007808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179095.233798:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788179095.233963:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788179095.235466:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e0c6300 x1875041472007808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179111 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179095.236091:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472007808:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788179095.808099:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179096.256880:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472007936:0@lo:400:kworker.0 00000100:00100000:0.0:1788179096.256974:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179096.257029:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9359baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041472008448:0@lo:400:kworker.0 00000100:00100000:0.0:1788179096.257059:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179096.257103:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788179096.257109:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041472008064:0@lo:400:kworker.0 00000100:00100000:0.0:1788179096.257132:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179096.257149:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9359bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472008576:0@lo:400:kworker.0 00000100:00100000:0.0:1788179096.257173:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179096.257206:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041472008192:0@lo:400:kworker.0 00000100:00100000:1.0:1788179096.257794:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472008448 00000100:00100000:1.0:1788179096.257806:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472008448 00000100:00100000:1.0:1788179096.257880:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472008064 00000100:00100000:1.0:1788179096.257883:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472008064 00000100:00100000:1.0:1788179096.257906:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788179096.257915:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875041472008448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179096.257974:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875041472008448:12345-0@lo:400:kworker.0 Request processed in 60us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179096.257981:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788179096.257997:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788179096.258003:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041472008064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179096.258029:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041472008064:12345-0@lo:400:kworker.0 Request processed in 27us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179096.258036:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788179096.258053:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472007936 00000100:00100000:1.0:1788179096.258057:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472007936 00000100:00100000:1.0:1788179096.258079:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788179096.258085:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:3307:x1875041472007936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179096.258112:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:3307:x1875041472007936:12345-0@lo:400:kworker.0 Request processed in 27us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179096.258130:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788179096.258158:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9359b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472008320:0@lo:400:kworker.0 00000100:00100000:1.0:1788179096.258185:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788179096.258215:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788179096.259164:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472008576 00000100:00100000:3.0:1788179096.259173:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472008576 00000100:00100000:0.0:1788179096.259600:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179096.264904:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472008320 00000100:00100000:3.0:1788179096.264920:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472008320 00000100:00100000:3.0:1788179096.264949:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788179096.264961:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472008576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179096.265756:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472008576:12345-0@lo:400:kworker.0 Request processed in 793us (8577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179096.265765:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788179096.265789:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788179096.265797:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472008320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179096.265875:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472008320:12345-0@lo:400:kworker.0 Request processed in 79us (7688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179096.265881:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1788179096.269667:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788179096.269921:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041472008064:0@lo:400:kworker.0 00010000:00080000:0.0:1788179096.269944:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc9359bb800 x1875041472008576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179096.269957:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9359bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472008576:0@lo:400:kworker.0 00000100:00100000:0.0:1788179096.269969:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472007936:0@lo:400:kworker.0 00000100:00100000:0.0:1788179096.269982:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9359baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041472008448:0@lo:400:kworker.0 00010000:00080000:0.0:1788179096.270077:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc9359b8000 x1875041472008320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179096.270087:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9359b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472008320:0@lo:400:kworker.0 00000100:00100000:3.0:1788179096.270255:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472008192 00000100:00100000:3.0:1788179096.270263:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472008192 00000100:00080000:3.0:1788179096.270307:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788179096.270352:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788179096.270362:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041472008192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179096.270454:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041472008192:12345-0@lo:400:kworker.0 Request processed in 94us (10857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179096.270461:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788179096.270495:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041472008192:0@lo:400:kworker.0 00000100:00100000:2.0:1788179096.771380:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472008704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788179096.771452:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179096.771524:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472008704 00000100:00100000:2.0:1788179096.771900:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472008704 00000100:00100000:2.0:1788179096.771951:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788179096.771960:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472008704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788179096.771997:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179096.772043:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472008704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179096.772060:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788179096.772102:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8ef480 x1875041472008704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179112 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179096.772121:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472008704:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788179096.832980:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179097.746616:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179097.746669:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179097.746703:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179097.746733:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450999936 00000100:00100000:3.0:1788179097.746743:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450999936 00000100:00100000:3.0:1788179097.746797:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451000064 00000100:00100000:3.0:1788179097.746801:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451000064 00000100:00100000:3.0:1788179097.746825:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 97 00000100:00100000:3.0:1788179097.746835:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2356:x1875041450999936:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788179097.746890:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 98 00000100:00100000:2.0:1788179097.746903:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90703ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2356:x1875041451000064:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788179097.746938:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2356:x1875041450999936:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 104us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179097.746946:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 97 00000100:00080000:3.0:1788179097.746970:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788179097.747126:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041450999808 00000100:00100000:2.0:1788179097.747131:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041450999808 00000100:00100000:2.0:1788179097.747167:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 248 00000100:00100000:2.0:1788179097.747174:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90353a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2356:x1875041450999808:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788179097.747213:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90353a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2356:x1875041450999808:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 40us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179097.747219:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 248 00000100:00100000:3.0:1788179097.750450:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90703ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2356:x1875041451000064:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 3538us (3733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179097.750479:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 98 00010000:00010000:0.0:1788179097.856287:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788179098.378089:0:11318:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 08:24:56 (1788179096) === 00000100:00100000:3.0:1788179098.800946:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179098.801065:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451000192 00000100:00100000:0.0:1788179098.801075:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451000192 00000100:00100000:0.0:1788179098.801135:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:0.0:1788179098.801146:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2356:x1875041451000192:12345-192.168.202.2@tcp:41:mkdir.0 00000004:00000024:0.0:1788179098.801201:0:5797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788179098.801332:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2356:x1875041451000192:12345-192.168.202.2@tcp:41:mkdir.0 Request processed in 187us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179098.801339:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:2.0:1788179098.805319:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179098.805486:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451000320 00000100:00100000:1.0:1788179098.805497:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451000320 00000100:00100000:1.0:1788179098.805555:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:1.0:1788179098.805565:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:9648:x1875041451000320:12345-192.168.202.2@tcp:700:mkdir.0 00000100:00100000:1.0:1788179098.805662:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:9648:x1875041451000320:12345-192.168.202.2@tcp:700:mkdir.0 Request processed in 97us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179098.805670:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:2.0:1788179098.816942:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179098.817018:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451000576 00000100:00100000:3.0:1788179098.817029:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451000576 00000100:00100000:3.0:1788179098.817088:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:3.0:1788179098.817099:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:9648:x1875041451000576:12345-192.168.202.2@tcp:36:mkdir.0 00010000:00010000:3.0:1788179098.817157:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179098.817408:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c4989ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661eba expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.817472:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc903340100) 00010000:00010000:3.0:1788179098.817500:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788179098.817803:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498b0c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.817817:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498b0c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.817828:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498b0c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.818178:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498b13 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.818197:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498b13 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.818206:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498b13 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179098.834090:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1788179098.834111:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498b0c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.836612:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498b0c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.836623:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498b0c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.836629:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4600 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179098.836634:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498b0c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.836644:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498b0c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.836663:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc902d54500) 00010000:00010000:3.0:1788179098.836667:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179098.836672:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498b0c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.836679:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498b0c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788179098.836708:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003e4b9ebf reply state 00000000011d3170 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498b13 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179098.836718:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788179098.836869:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:9648:x1875041451000576:12345-192.168.202.2@tcp:36:mkdir.0 Request processed in 19749us (19914us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788179098.836895:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00010000:00010000:1.0:1788179098.858260:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498b13 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179098.858278:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498b13 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179098.858286:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498b13 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179098.858292:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5600 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179098.858297:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498b13 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179098.858304:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498b13 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179098.858320:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bc902d54200) 00010000:00010000:1.0:1788179098.858338:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179098.858344:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498b13 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179098.858350:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498b13 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179098.875782:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179098.875940:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451000704 00000100:00100000:0.0:1788179098.875955:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451000704 00000100:00100000:0.0:1788179098.876031:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:0.0:1788179098.876042:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:9650:x1875041451000704:12345-192.168.202.2@tcp:101:chmod.0 00010000:00010000:0.0:1788179098.876070:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179098.876102:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030a00/0xaa4c98508c498b1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474661f3f expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179098.876172:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030800/0xaa4c98508c498b21 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179098.876186:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030800/0xaa4c98508c498b21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179098.876212:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030800/0xaa4c98508c498b21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179098.876287:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1788179098.876292:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788179098.876331:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030800/0xaa4c98508c498b21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179098.876393:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030a00/0xaa4c98508c498b1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f3f expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179098.876414:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030800/0xaa4c98508c498b21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f3f expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179098.876442:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc9062cb500) 00010000:00010000:0.0:1788179098.876444:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788179098.876448:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc900030800, rc 0) 00000100:00100000:0.0:1788179098.876511:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:9650:x1875041451000704:12345-192.168.202.2@tcp:101:chmod.0 Request processed in 469us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179098.876517:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00010000:00010000:0.0:1788179098.880134:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179098.882792:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179098.882895:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451000960 00000100:00100000:2.0:1788179098.882908:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451000960 00000100:00100000:2.0:1788179098.882970:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:2.0:1788179098.882980:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:9650:x1875041451000960:12345-192.168.202.2@tcp:36:chmod.0 00010000:00010000:2.0:1788179098.883036:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179098.883063:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030800/0xaa4c98508c498b21 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f3f expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179098.883101:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc9062cb500) 00010000:00010000:2.0:1788179098.883113:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788179098.883141:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498b28 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179098.883153:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498b28 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179098.883175:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498b28 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788179098.883515:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c6bb6ab6 reply state 00000000654308a0 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498b28 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179098.883524:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788179098.883539:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1788179098.884402:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:9650:x1875041451000960:12345-192.168.202.2@tcp:36:chmod.0 Request processed in 1418us (1616us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788179098.884412:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 17 00010000:00010000:1.0:1788179098.913695:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498b28 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179098.913718:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498b28 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179098.913726:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498b28 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179098.913732:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5e00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179098.913737:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498b28 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179098.913746:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498b28 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179098.913766:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc909481400) 00010000:00010000:1.0:1788179098.913769:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788179098.913775:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498b28 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179098.913782:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498b28 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179098.939144:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179098.939315:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451001088 00000100:00100000:3.0:1788179098.939325:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451001088 00000100:00100000:3.0:1788179098.939387:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:3.0:1788179098.939397:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:9651:x1875041451001088:12345-192.168.202.2@tcp:101:chown.0 00010000:00010000:3.0:1788179098.939420:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179098.939443:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498b2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474661f46 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.939520:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498b36 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.939535:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498b36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.939549:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498b36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179098.939627:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788179098.939632:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788179098.939680:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498b36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.939707:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498b2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f46 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.939726:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498b36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f46 expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.939765:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc902d54500) 00010000:00010000:3.0:1788179098.939768:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788179098.939772:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b5a00, rc 0) 00000100:00100000:3.0:1788179098.939837:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:9651:x1875041451001088:12345-192.168.202.2@tcp:101:chown.0 Request processed in 441us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179098.939844:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:2.0:1788179098.943562:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179098.943792:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451001216 00000100:00100000:3.0:1788179098.943803:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451001216 00000100:00100000:3.0:1788179098.944056:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:3.0:1788179098.944067:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:9651:x1875041451001216:12345-192.168.202.2@tcp:101:chown.0 00010000:00010000:3.0:1788179098.944089:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179098.944107:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498b3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474661f4d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.944182:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498b44 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.944205:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498b44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.944216:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498b44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.944236:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498b4b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.944243:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498b4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.944271:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498b4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.944376:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c498b52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.944384:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c498b52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.944390:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c498b52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179098.944444:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1788179098.944449:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788179098.944472:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c498b52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.944483:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498b44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.944490:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498b44 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.944497:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498b44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.944503:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5600 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179098.944507:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498b44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.944515:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498b44 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.944535:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc902d54500) 00010000:00010000:3.0:1788179098.944538:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179098.944543:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498b44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.944549:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498b44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.944561:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498b4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.944567:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498b4b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.944572:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498b4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.944577:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4400 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179098.944580:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498b4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.944597:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498b4b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.944605:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bc902d54e00) 00010000:00010000:3.0:1788179098.944607:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179098.944610:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498b4b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.944615:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498b4b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.944660:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498b3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f4d expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.944674:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c498b52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f4d expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.944681:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bc902d54a00) 00010000:00010000:3.0:1788179098.944683:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788179098.944685:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b5000, rc 0) 00000100:00100000:3.0:1788179098.944740:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+9:9651:x1875041451001216:12345-192.168.202.2@tcp:101:chown.0 Request processed in 675us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179098.944747:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:2.0:1788179098.956424:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179098.956519:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451001472 00000100:00100000:3.0:1788179098.956531:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451001472 00000100:00100000:3.0:1788179098.956600:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:3.0:1788179098.956610:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+9:9651:x1875041451001472:12345-192.168.202.2@tcp:36:chown.0 00010000:00010000:3.0:1788179098.956677:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179098.956706:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c498b52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f4d expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.956728:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bc902d54a00) 00010000:00010000:3.0:1788179098.956741:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788179098.956772:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498b59 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.956787:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498b59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179098.956816:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498b59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788179099.030226:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:3.0:1788179099.030277:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1788179099.030807:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000285d5eff reply state 00000000728fbe4c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498b59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179099.030822:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788179099.031043:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:0.0:1788179099.031149:0:5797:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788179099.031182:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:9651:x1875041451001472:12345-192.168.202.2@tcp:36:chown.0 Request processed in 74568us (74768us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788179099.031191:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00010000:00010000:3.0:1788179099.032465:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498b59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.032492:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498b59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.032499:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498b59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.032505:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4c00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179099.032510:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498b59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.032517:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498b59 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.032535:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bc902d54300) 00010000:00010000:3.0:1788179099.032538:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788179099.032543:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498b59 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.032549:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498b59 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179099.059487:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179099.059730:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451001600 00000100:00100000:3.0:1788179099.059744:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451001600 00000100:00100000:3.0:1788179099.059842:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:3.0:1788179099.059885:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:9652:x1875041451001600:12345-192.168.202.2@tcp:101:touch.500 00010000:00010000:3.0:1788179099.059918:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179099.059941:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498b60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474661f54 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788179099.061338:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1788179099.061385:0:5796:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1392us 00010000:00010000:3.0:1788179099.073048:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c498b67 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.073070:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c498b67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.073081:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c498b67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.073094:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498b6e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.073100:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498b6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.073106:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498b6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.073530:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498b75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.073539:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498b75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.073547:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498b75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179099.073633:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788179099.073637:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788179099.073718:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498b75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.073733:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c498b67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.073739:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c498b67 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.073746:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c498b67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.073752:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179099.073757:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c498b67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.073763:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c498b67 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.073775:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc902d54500) 00010000:00010000:3.0:1788179099.073778:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179099.073783:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c498b67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.073789:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c498b67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.073798:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498b6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.073813:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498b6e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.073818:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498b6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.073822:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4600 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179099.073825:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498b6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.073830:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498b6e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.073838:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bc902d54300) 00010000:00010000:3.0:1788179099.073840:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179099.073843:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498b6e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.073886:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498b6e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.073931:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498b60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f54 expref: 8 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.073945:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498b75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f54 expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.073954:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bc902d54a00) 00010000:00010000:3.0:1788179099.073957:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788179099.073965:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4400, rc 0) 00000100:00100000:3.0:1788179099.074050:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:9652:x1875041451001600:12345-192.168.202.2@tcp:101:touch.500 Request processed in 14166us (14580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179099.074059:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:1.0:1788179099.077636:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179099.077742:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451001856 00000100:00100000:3.0:1788179099.077752:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451001856 00000100:00100000:3.0:1788179099.077813:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:3.0:1788179099.077823:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:9652:x1875041451001856:12345-192.168.202.2@tcp:101:touch.500 00010000:00010000:3.0:1788179099.077845:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179099.077915:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498b7c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474661f5b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.078303:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498b83 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.078319:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498b83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.078332:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498b83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.078346:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c498b8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.078353:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c498b8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.078360:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c498b8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788179099.079175:0:5827:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788179099.079463:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498b91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.079474:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.079483:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.079520:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498b83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.079528:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498b83 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.079534:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498b83 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.079540:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179099.079545:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498b83 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.079554:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498b83 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.079575:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bc902d54a00) 00010000:00010000:3.0:1788179099.079578:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179099.079583:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498b83 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.079589:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498b83 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788179099.079615:0:5827:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a7e983c5 reply state 000000007acb0920 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c498b8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179099.079624:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788179099.079663:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498b7c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f5b expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.079678:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498b91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f5b expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.079685:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bc902d54e00) 00010000:00010000:3.0:1788179099.079688:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788179099.079690:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc901499e00, rc 0) 00000100:00100000:3.0:1788179099.079777:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+10:9652:x1875041451001856:12345-192.168.202.2@tcp:101:touch.500 Request processed in 1954us (2150us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788179099.079785:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 22 00010000:00010000:2.0:1788179099.082661:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c498b8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.082678:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c498b8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.082703:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c498b8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.082708:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4e00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179099.082714:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c498b8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.082721:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c498b8a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.082736:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x48a8de3 (ffff9bc902d54200) 00010000:00010000:2.0:1788179099.082739:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179099.082744:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c498b8a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.082750:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c498b8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179099.084449:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179099.084786:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451002112 00000100:00100000:3.0:1788179099.084798:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451002112 00000100:00100000:3.0:1788179099.084904:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:3.0:1788179099.084915:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+9:9652:x1875041451002112:12345-192.168.202.2@tcp:36:touch.500 00010000:00010000:3.0:1788179099.084974:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179099.084999:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498b91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f5b expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.085015:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bc902d54e00) 00010000:00010000:3.0:1788179099.085026:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788179099.085079:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498b9f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.085093:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498b9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.085103:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498b9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788179099.085451:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000561471a9 reply state 000000002109df80 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498b9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179099.085460:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788179099.085637:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+10:9652:x1875041451002112:12345-192.168.202.2@tcp:36:touch.500 Request processed in 721us (1193us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788179099.085644:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 23 00010000:00010000:3.0:1788179099.087800:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498b9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.087817:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498b9f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.087824:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498b9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.087830:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc901498000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179099.087835:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498b9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.087842:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498b9f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.087894:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bc902d54300) 00010000:00010000:3.0:1788179099.087910:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179099.087916:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498b9f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.087922:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498b9f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179099.089914:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179099.090075:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451002240 00000100:00100000:0.0:1788179099.090085:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451002240 00000100:00100000:0.0:1788179099.090145:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:0.0:1788179099.090156:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+9:9652:x1875041451002240:12345-192.168.202.2@tcp:101:touch.500 00010000:00010000:0.0:1788179099.090182:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179099.090207:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030a00/0xaa4c98508c498ba6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474661f62 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179099.090299:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030a00/0xaa4c98508c498ba6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f62 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179099.090313:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030a00/0xaa4c98508c498ba6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f62 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179099.090333:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bc9062cb500) 00010000:00010000:0.0:1788179099.090336:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788179099.090340:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc900030a00, rc 0) 00000100:00100000:0.0:1788179099.090400:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+10:9652:x1875041451002240:12345-192.168.202.2@tcp:101:touch.500 Request processed in 246us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179099.090407:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:1.0:1788179099.093910:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179099.093996:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451002368 00000100:00100000:3.0:1788179099.094006:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451002368 00000100:00100000:3.0:1788179099.094050:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:3.0:1788179099.094058:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1875041451002368:12345-192.168.202.2@tcp:8:touch.500 00010000:00080000:3.0:1788179099.094093:0:6589:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 334bb25c-6762-4beb-8a84-3a838cbc7e80@192.168.202.2@tcp t0 exp 0000000000000000 cur 295 last 0 00000020:00000080:3.0:1788179099.094126:0:6589:0:(genops.c:1407:class_connect()) connect: client 334bb25c-6762-4beb-8a84-3a838cbc7e80, cookie 0xaa4c98508c498bad 00002000:00100000:3.0:1788179099.094140:0:6589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 334bb25c-6762-4beb-8a84-3a838cbc7e80/ffff9bc9359e7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211371b ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788179099.094165:0:6589:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788179099.094628:0:6589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788179099.094660:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9bc9359e3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788179099.094840:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2353:x1875041451002368:12345-192.168.202.2@tcp:8:touch.500 Request processed in 779us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179099.094872:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:2.0:1788179099.101840:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179099.104516:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451002496 00000100:00100000:0.0:1788179099.104658:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451002496 00000100:00100000:0.0:1788179099.104774:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:0.0:1788179099.104785:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:0:x1875041451002496:12345-192.168.202.2@tcp:2:touch.500 00000100:00080000:3.0:1788179099.105474:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788179099.154032:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1788179099.154273:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:0:x1875041451002496:12345-192.168.202.2@tcp:2:touch.500 Request processed in 49484us (52436us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788179099.154285:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 17 00000001:00100000:3.0:1788179099.159104:0:6618:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 334bb25c-6762-4beb-8a84-3a838cbc7e80 00000100:00100000:1.0:1788179099.161316:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179099.161462:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451002752 00000100:00100000:0.0:1788179099.161484:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451002752 00000100:00100000:0.0:1788179099.161545:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:0.0:1788179099.161556:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+10:9652:x1875041451002752:12345-192.168.202.2@tcp:35:touch.500 00000100:00100000:0.0:1788179099.162063:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+11:9652:x1875041451002752:12345-192.168.202.2@tcp:35:touch.500 Request processed in 507us (754us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788179099.162071:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:1.0:1788179099.174740:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179099.174835:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451002880 00000100:00100000:2.0:1788179099.174845:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451002880 00000100:00100000:2.0:1788179099.174946:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:2.0:1788179099.174956:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+11:9653:x1875041451002880:12345-192.168.202.2@tcp:101:rm.0 00010000:00010000:2.0:1788179099.174979:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179099.175003:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498bb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474661f69 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.175090:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c498bbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.175108:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c498bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.175121:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c498bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179099.175200:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788179099.175204:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788179099.175244:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c498bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.175291:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498bb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f69 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.175310:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c498bbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f69 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.175319:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bc902d54a00) 00010000:00010000:2.0:1788179099.175322:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788179099.175326:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c4a00, rc 0) 00000100:00100000:2.0:1788179099.175392:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+12:9653:x1875041451002880:12345-192.168.202.2@tcp:101:rm.0 Request processed in 438us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179099.175400:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:2.0:1788179099.179366:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179099.180122:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451003136 00000100:00100000:3.0:1788179099.180133:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451003136 00000100:00100000:2.0:1788179099.180413:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00100000:2.0:1788179099.180452:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+12:9653:x1875041451003136:12345-192.168.202.2@tcp:101:rm.0 00010000:00010000:2.0:1788179099.180576:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179099.180610:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498bc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474661f70 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179099.180730:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1788179099.180892:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498bc2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f70 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.180906:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc902d54500) 00010000:00010000:2.0:1788179099.180909:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788179099.180914:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498bc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f70 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.180928:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c5000, rc 0) 00000100:00100000:2.0:1788179099.180992:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+13:9653:x1875041451003136:12345-192.168.202.2@tcp:101:rm.0 Request processed in 543us (1636us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1788179099.180998:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00100000:1.0:1788179099.189792:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179099.189894:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451003264 00000100:00100000:0.0:1788179099.189904:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451003264 00000100:00100000:0.0:1788179099.189958:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:0.0:1788179099.189967:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+13:9653:x1875041451003264:12345-192.168.202.2@tcp:37:rm.0 00000100:00100000:0.0:1788179099.201975:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+13:9653:x1875041451003264:12345-192.168.202.2@tcp:37:rm.0 Request processed in 11994us (12179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179099.201990:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:2.0:1788179099.206463:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179099.206617:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451003520 00000100:00100000:3.0:1788179099.206627:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451003520 00000100:00100000:3.0:1788179099.206688:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:3.0:1788179099.206698:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9266fe850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+13:9653:x1875041451003520:12345-192.168.202.2@tcp:35:rm.0 00000100:00100000:3.0:1788179099.207022:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9266fe850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+14:9653:x1875041451003520:12345-192.168.202.2@tcp:35:rm.0 Request processed in 324us (568us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788179099.207030:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:1.0:1788179099.210202:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179099.210307:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451003776 00000100:00100000:2.0:1788179099.210318:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451003776 00000100:00100000:2.0:1788179099.210383:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:2.0:1788179099.210395:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+14:9653:x1875041451003776:12345-192.168.202.2@tcp:101:rm.0 00010000:00010000:2.0:1788179099.210438:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179099.210462:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c498bd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474661f77 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.210634:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c498bd7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.210648:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c498bd7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.210659:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c498bd7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179099.210670:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1788179099.210788:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c498bd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f77 expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.210808:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c498bd7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f77 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.210816:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bc902d54a00) 00010000:00010000:2.0:1788179099.210819:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788179099.210822:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c4600, rc 0) 00000100:00100000:2.0:1788179099.211153:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+16:9653:x1875041451003776:12345-192.168.202.2@tcp:101:rm.0 Request processed in 761us (960us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788179099.211161:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:2.0:1788179099.214565:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179099.214674:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451003904 00000100:00100000:0.0:1788179099.214685:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451003904 00000100:00100000:0.0:1788179099.214777:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:0.0:1788179099.214788:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+16:9653:x1875041451003904:12345-192.168.202.2@tcp:41:rm.0 00000004:00000024:1.0:1788179099.215317:0:5797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1788179099.215443:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+16:9653:x1875041451003904:12345-192.168.202.2@tcp:41:rm.0 Request processed in 654us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179099.215451:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:0.0:1788179099.218298:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179099.218705:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451004032 00000100:00100000:2.0:1788179099.218715:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451004032 00000100:00100000:2.0:1788179099.218782:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:2.0:1788179099.218792:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+16:9653:x1875041451004032:12345-192.168.202.2@tcp:101:rm.0 00010000:00010000:2.0:1788179099.218828:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179099.218877:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c498be5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474661f7e expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.218942:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c498bec lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.218953:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c498bec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.218961:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c498bec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.218972:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498bf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.218976:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.218980:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.219079:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498bfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.219084:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498bfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.219088:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498bfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179099.219108:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788179099.219116:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788179099.219132:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498bfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.219140:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498bfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.219146:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c498bec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.219150:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c498bec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.219154:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c498bec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.219159:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c4000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179099.219163:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c498bec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.219170:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c498bec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.219181:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bc902d54a00) 00010000:00010000:2.0:1788179099.219184:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179099.219256:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c498bec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.219263:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c498bec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.219280:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.219299:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498bf3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.219305:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.219310:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179099.219313:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.219318:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498bf3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.219326:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x48a8de3 (ffff9bc909481c00) 00010000:00010000:2.0:1788179099.219329:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179099.219331:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498bf3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.219337:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498bf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.219378:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c498be5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f7e expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.219390:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498bfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f7e expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.219397:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bc9062cb500) 00010000:00010000:2.0:1788179099.219399:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788179099.219408:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c5e00, rc 0) 00000100:00100000:2.0:1788179099.220707:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+17:9653:x1875041451004032:12345-192.168.202.2@tcp:101:rm.0 Request processed in 1908us (2411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179099.220718:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:0.0:1788179099.226016:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179099.226120:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451004288 00000100:00100000:2.0:1788179099.226130:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451004288 00000100:00100000:2.0:1788179099.226246:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 30 00000100:00100000:2.0:1788179099.226270:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+17:9653:x1875041451004288:12345-192.168.202.2@tcp:36:rm.0 00010000:00010000:2.0:1788179099.226324:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788179099.226352:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498bfa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f7e expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.226375:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030a00/0xaa4c98508c498ba6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f62 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.226387:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bc9062cb500) 00010000:00010000:2.0:1788179099.226403:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c498bbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f69 expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.226411:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bc902d54a00) 00010000:00010000:2.0:1788179099.226414:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788179099.226434:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c498c01 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.226448:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c498c01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.226456:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c498c01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.226490:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498c08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.226498:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498c08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.226505:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498c08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.226635:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c498c0f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.226644:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c498c0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.226651:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c498c0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788179099.227436:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788179099.227447:0:5827:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 295290597073ns, next at 296290594146ns, rc = 0 00010000:00010000:2.0:1788179099.227513:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498c16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.227524:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498c16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.227533:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498c16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.227541:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498c16 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.227559:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498c16 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.227566:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498c16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.227585:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788179099.227605:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c498c0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.227611:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c498c0f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.227617:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c498c0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.227622:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c4000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179099.227627:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c498c0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.227635:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c498c0f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.227645:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bc909481100) 00010000:00010000:2.0:1788179099.227648:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788179099.227652:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c498c0f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.227658:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c498c0f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.227675:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c498c01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.227688:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c498c01 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.227694:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c498c01 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.227699:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179099.227702:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c498c01 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.227708:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c498c01 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.227716:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bc902d54a00) 00010000:00010000:2.0:1788179099.227718:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179099.227722:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c498c01 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179099.227727:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c498c01 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788179099.227737:0:5827:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000041d4bd82 reply state 0000000049e76b99 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498c08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179099.227745:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788179099.227830:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+16:9653:x1875041451004288:12345-192.168.202.2@tcp:36:rm.0 Request processed in 1560us (1821us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788179099.227837:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 30 00010000:00010000:3.0:1788179099.227952:0:6605:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788179099.227959:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498c16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.227965:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5600 already unused, calling callback (ffffffffc1644220) 00010000:00010000:3.0:1788179099.227968:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498c16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.227973:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498c16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.227981:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9bc909481100) 00010000:00010000:3.0:1788179099.227983:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788179099.227986:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498c16 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.227991:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498c16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.228011:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179099.228013:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179099.228015:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179099.230820:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498c08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179099.230839:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498c08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179099.230981:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498c08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179099.230990:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179099.230995:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498c08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179099.231004:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498c08 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179099.231022:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x48a8de3 (ffff9bc909481c00) 00010000:00010000:1.0:1788179099.231025:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179099.231031:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498c08 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179099.231057:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498c08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179099.233372:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179099.233518:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451004544 00000100:00100000:3.0:1788179099.233530:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451004544 00000100:00100000:3.0:1788179099.233612:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:3.0:1788179099.233624:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+15:9653:x1875041451004544:12345-192.168.202.2@tcp:35:rm.0 00000100:00100000:3.0:1788179099.233940:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+16:9653:x1875041451004544:12345-192.168.202.2@tcp:35:rm.0 Request processed in 317us (580us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788179099.233958:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:2.0:1788179099.242027:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179099.242405:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451004800 00000100:00100000:3.0:1788179099.242416:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451004800 00000100:00100000:3.0:1788179099.242523:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:3.0:1788179099.242544:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+16:9653:x1875041451004800:12345-192.168.202.2@tcp:36:rm.0 00010000:00010000:3.0:1788179099.242616:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788179099.242644:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c498bd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f77 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.242665:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498b75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f54 expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.242676:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bc902d54a00) 00010000:00010000:3.0:1788179099.242692:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498b36 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f46 expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.242700:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc902d54500) 00010000:00010000:3.0:1788179099.242706:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788179099.242728:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498c1d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.242739:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498c1d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.242747:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498c1d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.242757:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498c24 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.242777:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498c24 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.242784:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498c24 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.243106:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498c2b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.243116:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498c2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.243123:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498c2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179099.243956:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1788179099.243972:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498c2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.243980:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498c2b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.243987:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498c2b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.243993:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc901498400 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179099.243997:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498c2b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.244005:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498c2b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.244026:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:3.0:1788179099.244029:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788179099.244033:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498c2b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.244039:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498c2b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.244061:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498c1d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.244068:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498c1d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.244074:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498c1d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.244079:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc901498000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179099.244082:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498c1d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.244088:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498c1d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.244095:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc902d54300) 00010000:00010000:3.0:1788179099.244098:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179099.244101:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498c1d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.244107:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498c1d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788179099.244130:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000066de08e6 reply state 0000000064a22588 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498c24 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179099.244141:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788179099.244922:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+15:9653:x1875041451004800:12345-192.168.202.2@tcp:36:rm.0 Request processed in 2374us (2897us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788179099.244940:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 31 00010000:00010000:3.0:1788179099.255739:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498c24 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.255760:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498c24 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.255768:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498c24 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.255774:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc901499e00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179099.255778:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498c24 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.255786:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498c24 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.255802:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9bc902d54e00) 00010000:00010000:3.0:1788179099.255805:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179099.255809:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498c24 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179099.255815:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498c24 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179099.904061:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788179100.354993:0:6811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 296418140448ns, next at 297418138034ns, rc = 0 00000100:00100000:0.0:1788179100.355118:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472008832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788179100.355216:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179100.355725:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472008832 00000100:00100000:1.0:1788179100.355735:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472008832 00000100:00100000:1.0:1788179100.355811:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788179100.355821:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472008832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788179100.355886:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788179100.355946:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472008832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179100.355954:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1788179100.355995:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8d8380 x1875041472008832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788179100.356015:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472008832:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788179100.356268:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788179100.936633:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179101.376061:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875041472009088:0@lo:400:kworker.0 00000100:00100000:0.0:1788179101.376140:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179101.376185:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472009600:0@lo:400:kworker.0 00000100:00100000:0.0:1788179101.376211:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179101.376254:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788179101.376260:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041472008960:0@lo:400:kworker.0 00000100:00100000:0.0:1788179101.376291:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179101.376310:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041472009472:0@lo:400:kworker.0 00000100:00100000:0.0:1788179101.376332:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179101.376346:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041472009216:0@lo:400:kworker.0 00000100:00100000:0.0:1788179101.376374:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472009600 00000100:00100000:3.0:1788179101.376380:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179101.376381:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472009600 00000100:00100000:3.0:1788179101.376398:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788179101.376403:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472009344:0@lo:400:kworker.0 00000100:00100000:3.0:1788179101.376422:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179101.376429:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472009344 00000100:00100000:0.0:1788179101.376431:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472009344 00000100:00080000:3.0:1788179101.376444:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788179101.376452:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788179101.376457:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788179101.376460:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472009600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179101.376463:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90703aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472009344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179101.376505:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472009600:12345-0@lo:400:kworker.0 Request processed in 45us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179101.376506:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90703aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472009344:12345-0@lo:400:kworker.0 Request processed in 42us (81us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179101.376512:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788179101.376524:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788179101.376540:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472009088 00000100:00100000:0.0:1788179101.376543:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472009088 00000100:00100000:0.0:1788179101.376564:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472009472 00000100:00100000:0.0:1788179101.376567:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472009472 00010000:00080000:3.0:1788179101.376572:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93abbb800 x1875041472009344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179101.376583:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472009216 00000100:00100000:0.0:1788179101.376585:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472009216 00000100:00100000:3.0:1788179101.376586:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472009344:0@lo:400:kworker.0 00000100:00100000:0.0:1788179101.376597:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788179101.376602:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875041472009088:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788179101.376604:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788179101.376632:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875041472009088:12345-0@lo:400:kworker.0 Request processed in 29us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179101.376638:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788179101.376650:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788179101.376656:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041472009472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179101.376683:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041472009472:12345-0@lo:400:kworker.0 Request processed in 27us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179101.376688:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788179101.376702:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788179101.376708:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041472009216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179101.376748:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041472009216:12345-0@lo:400:kworker.0 Request processed in 40us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179101.376761:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788179101.376793:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041472009472:0@lo:400:kworker.0 00000100:00100000:0.0:1788179101.376802:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875041472009088:0@lo:400:kworker.0 00010000:00080000:0.0:1788179101.376810:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93abba680 x1875041472009600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179101.376818:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472009600:0@lo:400:kworker.0 00000100:00100000:1.0:1788179101.376957:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472008960 00000100:00100000:1.0:1788179101.376961:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472008960 00000100:00100000:3.0:1788179101.376965:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041472009216:0@lo:400:kworker.0 00000100:00100000:1.0:1788179101.376999:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788179101.377008:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc903538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:3308:x1875041472008960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179101.377060:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc903538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:3308:x1875041472008960:12345-0@lo:400:kworker.0 Request processed in 54us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179101.377066:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788179101.377147:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041472008960:0@lo:400:kworker.0 00000100:00100000:3.0:1788179101.889681:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472009728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788179101.889776:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179101.889990:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472009728 00000100:00100000:2.0:1788179101.890009:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472009728 00000100:00100000:2.0:1788179101.890070:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788179101.890102:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90703a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472009728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788179101.890148:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179101.890218:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90703a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472009728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179101.890235:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1788179101.890371:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc935496d80 x1875041472009728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179117 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179101.890390:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472009728:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788179101.952349:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788179102.859292:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179102.859413:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451005056 00000100:00100000:0.0:1788179102.859424:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451005056 00000100:00100000:0.0:1788179102.859507:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 102 00000100:00100000:0.0:1788179102.859521:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+14:2357:x1875041451005056:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179102.859600:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+14:2357:x1875041451005056:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 82us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179102.859609:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 102 00000100:00080000:2.0:1788179102.860058:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788179102.869976:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179102.870026:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179102.870074:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451004928 00000100:00100000:0.0:1788179102.870097:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451004928 00000100:00100000:0.0:1788179102.870159:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 250 00000100:00100000:0.0:1788179102.870171:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90353b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2357:x1875041451004928:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179102.870252:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90353b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2357:x1875041451004928:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 83us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179102.870260:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 250 00000100:00100000:1.0:1788179102.872495:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451005312 00000100:00100000:1.0:1788179102.872510:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451005312 00000100:00100000:3.0:1788179102.872519:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179102.872591:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 103 00000100:00100000:1.0:1788179102.872601:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2357:x1875041451005312:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179102.872682:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2357:x1875041451005312:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 81us (2720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179102.872690:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 103 00000100:00080000:1.0:1788179102.872710:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788179102.873004:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451005184 00000100:00100000:0.0:1788179102.873016:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451005184 00000100:00100000:0.0:1788179102.873053:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 58 00000100:00100000:0.0:1788179102.873062:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2357:x1875041451005184:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179102.873093:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2357:x1875041451005184:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 33us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179102.873100:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 58 00000100:00080000:1.0:1788179102.879369:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1788179102.954775:0:11467:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1788179102.984232:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179104.000159:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788179104.064071:0:11515:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc58707f0 20000000:00000080:3.0:1788179104.064088:0:11515:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bc92e79a800 uarg=0000000000000000 20000000:01000000:3.0:1788179104.064126:0:11515:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788179104.064138:0:11515:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788179104.064143:0:11515:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788179104.066244:0:11516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788179104.066420:0:11515:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788179104.077638:0:11515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788179104.077696:0:11515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788179104.077748:0:11515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788179104.077764:0:11515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788179104.077783:0:11515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bc901499e00/0xaa4c98508c498c32 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.077801:0:11515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc900030400/0xaa4c98508c498ad4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f31 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.077808:0:11515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc900030600/0xaa4c98508c498adb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f38 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.077815:0:11515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc900031e00/0xaa4c98508c498ae9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498ae2 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.077821:0:11515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc9136c4200/0xaa4c98508c498af7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498af0 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.077828:0:11515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc9137b5200/0xaa4c98508c498b05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498afe expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.077834:0:11515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bc901499e00/0xaa4c98508c498c32 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.078225:0:11515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc9137b5200/0xaa4c98508c498b05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c498afe expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.078242:0:11515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bc9137b5200/0xaa4c98508c498b05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c498afe expref: 18 pid: 5791 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179104.078265:0:11515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc90703b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11515:1875041472009856:0@lo:104: 00000100:00100000:3.0:1788179104.078338:0:11515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788179104.078403:0:11515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc9136c4200/0xaa4c98508c498af7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c498af0 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.078411:0:11515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bc9136c4200/0xaa4c98508c498af7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c498af0 expref: 18 pid: 5789 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179104.078419:0:11515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc907038a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11515:1875041472009984:0@lo:104: 00000100:00100000:3.0:1788179104.078442:0:11515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788179104.078474:0:11515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc900031e00/0xaa4c98508c498ae9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c498ae2 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.078482:0:11515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9bc900031e00/0xaa4c98508c498ae9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c498ae2 expref: 18 pid: 5791 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179104.078490:0:11515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc907039180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11515:1875041472010112:0@lo:104: 00000100:00100000:2.0:1788179104.078516:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472009856 00000100:00100000:3.0:1788179104.078517:0:11515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179104.078525:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472009856 00010000:00010000:3.0:1788179104.078540:0:11515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc900030600/0xaa4c98508c498adb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f38 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.078554:0:11515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bc900030600/0xaa4c98508c498adb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f38 expref: 12 pid: 5790 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179104.078565:0:11515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc907038380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11515:1875041472010240:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788179104.078579:0:5779:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788179104.078593:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472009984 00000100:00100000:2.0:1788179104.078597:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472009984 00000100:00100000:2.0:1788179104.078608:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472010112 00000100:00100000:2.0:1788179104.078610:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472010112 00000100:00100000:2.0:1788179104.078623:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1788179104.078628:0:11515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc900030400/0xaa4c98508c498ad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f31 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179104.078633:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90703a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efc6f743-3303-46d5-8807-513b82cac1cc+5:11515:x1875041472009856:12345-0@lo:104: 00010000:00010000:2.0:1788179104.078649:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4800/0xaa4c98508c498afe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498b05 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.078659:0:11515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bc900030400/0xaa4c98508c498ad4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f31 expref: 12 pid: 5791 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179104.078670:0:11515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc90703b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11515:1875041472010368:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788179104.078783:0:11515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc910967240 going to sleep for 11 seconds 00000100:00100000:3.0:1788179104.078808:0:11515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc90703b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11515:1875041472009856:0@lo:104: 00010000:00010000:2.0:1788179104.079025:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788179104.079031:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90703a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efc6f743-3303-46d5-8807-513b82cac1cc+5:11515:x1875041472009856:12345-0@lo:104: Request processed in 401us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179104.079036:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788179104.079057:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788179104.079062:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907038e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efc6f743-3303-46d5-8807-513b82cac1cc+4:11515:x1875041472009984:12345-0@lo:104: 00010000:00010000:2.0:1788179104.079068:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c498af0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498af7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179104.079093:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788179104.079102:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4800/0xaa4c98508c498afe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498b05 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179104.079104:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1788179104.079114:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4800 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:1.0:1788179104.079118:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4800/0xaa4c98508c498afe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c498b05 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179104.079127:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4800/0xaa4c98508c498afe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c498b05 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788179104.079133:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4800/0xaa4c98508c498afe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c498b05 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788179104.079139:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788179104.079171:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4800/0xaa4c98508c498afe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498b05 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179104.079177:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788179104.079196:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4800/0xaa4c98508c498afe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498b05 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179104.079221:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4800/0xaa4c98508c498afe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498b05 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179104.079233:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788179104.079237:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c498af0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498af7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179104.079242:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5e00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:1.0:1788179104.079245:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c498af0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c498af7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179104.079253:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907038e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efc6f743-3303-46d5-8807-513b82cac1cc+4:11515:x1875041472009984:12345-0@lo:104: Request processed in 188us (808us total) trans 0 rc 0/0 00010000:00010000:1.0:1788179104.079255:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c498af0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c498af7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179104.079269:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 10000000:00010000:1.0:1788179104.079271:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c498af0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c498af7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788179104.079278:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788179104.079288:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1788179104.079296:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c498af0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498af7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179104.079297:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93ab20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efc6f743-3303-46d5-8807-513b82cac1cc+3:11515:x1875041472010112:12345-0@lo:104: 00010000:00010000:1.0:1788179104.079310:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788179104.079313:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5800/0xaa4c98508c498ae2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498ae9 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179104.079336:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c498af0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498af7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179104.079344:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c498af0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498af7 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179104.079353:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179104.079360:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179104.079362:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179104.079384:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041472010496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788179104.079420:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788179104.079464:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788179104.079464:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472010624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788179104.079474:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93ab20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efc6f743-3303-46d5-8807-513b82cac1cc+3:11515:x1875041472010112:12345-0@lo:104: Request processed in 178us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179104.079481:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788179104.079499:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179104.079541:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472010496 00000100:00100000:1.0:1788179104.079546:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472010496 00010000:00010000:1.0:1788179104.079565:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc9137b5200/0xaa4c98508c498b05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c498afe expref: 19 pid: 5791 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179104.079591:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472010624 00000100:00100000:1.0:1788179104.079595:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472010624 00010000:00010000:1.0:1788179104.079606:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc9136c4200/0xaa4c98508c498af7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c498af0 expref: 20 pid: 5789 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179104.079618:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788179104.079624:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+20:3306:x1875041472010496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788179104.079634:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788179104.079639:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc9137b5200/0xaa4c98508c498b05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c498afe expref: 20 pid: 5791 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179104.079649:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc9137b5200/0xaa4c98508c498b05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c498afe expref: 20 pid: 5791 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179104.079663:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc9137b5200/0xaa4c98508c498b05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c498afe expref: 20 pid: 5791 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179104.079673:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788179104.079702:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+19:3306:x1875041472010496:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179104.079715:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788179104.079728:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788179104.079734:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+18:3307:x1875041472010624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788179104.079741:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788179104.079746:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc9136c4200/0xaa4c98508c498af7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c498af0 expref: 18 pid: 5789 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179104.079754:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc9136c4200/0xaa4c98508c498af7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c498af0 expref: 18 pid: 5789 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179104.079764:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788179104.079789:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+18:3307:x1875041472010624:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179104.079795:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788179104.079823:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472010624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788179104.079877:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041472010496:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788179104.080109:0:11515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc9136c4200/0xaa4c98508c498af7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c498af0 expref: 17 pid: 5789 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179104.080121:0:11515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc907038a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11515:1875041472009984:0@lo:104: 00000100:00100000:3.0:1788179104.080130:0:11515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc907039180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11515:1875041472010112:0@lo:104: 00010000:00010000:2.0:1788179104.082249:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788179104.082262:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5800/0xaa4c98508c498ae2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c498ae9 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179104.082270:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5800 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:2.0:1788179104.082273:0:6606:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5800/0xaa4c98508c498ae2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c498ae9 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179104.082281:0:6606:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5800/0xaa4c98508c498ae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c498ae9 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788179104.082303:0:6606:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5800/0xaa4c98508c498ae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c498ae9 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788179104.082307:0:6606:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788179104.082502:0:6606:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5800/0xaa4c98508c498ae2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498ae9 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179104.082507:0:6606:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788179104.082563:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1788179104.082611:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5800/0xaa4c98508c498ae2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498ae9 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179104.082617:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc9136c5800/0xaa4c98508c498ae2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c498ae9 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179104.082640:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179104.082642:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179104.082643:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179104.085030:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472010752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788179104.085209:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788179104.085930:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179104.092964:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472010752 00000100:00100000:1.0:1788179104.092980:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472010752 00010000:00010000:1.0:1788179104.093023:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc900031e00/0xaa4c98508c498ae9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c498ae2 expref: 17 pid: 5791 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179104.093063:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788179104.093072:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc905f67050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+17:3307:x1875041472010752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788179104.093088:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788179104.093094:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc900031e00/0xaa4c98508c498ae9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c498ae2 expref: 17 pid: 5791 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179104.093127:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc900031e00/0xaa4c98508c498ae9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c498ae2 expref: 17 pid: 5791 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179104.093145:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc900031e00/0xaa4c98508c498ae9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c498ae2 expref: 17 pid: 5791 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179104.093161:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788179104.093261:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc905f67050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+16:3307:x1875041472010752:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (8060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179104.093269:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788179104.093371:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472010752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788179104.096226:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179104.096293:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179104.096307:0:11515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc907038380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11515:1875041472010240:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788179104.096325:0:11515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc90703b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11515:1875041472010368:192.168.202.2@tcp:104: 00000100:00100000:1.0:1788179104.096352:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451005568 00010000:00010000:3.0:1788179104.096358:0:11515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bc901499e00/0xaa4c98508c498c32 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179104.096359:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451005568 00010000:00010000:1.0:1788179104.096398:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc900030400/0xaa4c98508c498ad4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f31 expref: 13 pid: 5791 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179104.096413:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451005440 00000100:00100000:2.0:1788179104.096418:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451005440 00000100:00100000:1.0:1788179104.096440:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 33 00010000:00010000:2.0:1788179104.096443:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc900030600/0xaa4c98508c498adb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f38 expref: 14 pid: 5790 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179104.096454:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+14:2357:x1875041451005568:12345-192.168.202.2@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788179104.096466:0:5782:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788179104.096473:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788179104.096477:0:5782:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788179104.096480:0:5783:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788179104.096482:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc900030400/0xaa4c98508c498ad4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f31 expref: 14 pid: 5791 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179104.096492:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 34 00010000:00010000:1.0:1788179104.096492:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc900030400/0xaa4c98508c498ad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f31 expref: 14 pid: 5791 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179104.096499:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+14:2357:x1875041451005440:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788179104.096506:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788179104.096510:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc900030400/0xaa4c98508c498ad4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f31 expref: 14 pid: 5791 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.096511:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc900030600/0xaa4c98508c498adb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f38 expref: 14 pid: 5790 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179104.096525:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788179104.096529:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc900030600/0xaa4c98508c498adb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f38 expref: 13 pid: 5790 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.096550:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc900030600/0xaa4c98508c498adb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f38 expref: 13 pid: 5790 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.096560:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bc901499e00/0xaa4c98508c498c32 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.096568:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc901499e00/0xaa4c98508c498c32 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.096580:0:5783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bc901499e00/0xaa4c98508c498c32 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179104.096585:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+12:2357:x1875041451005568:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 136us (382us total) trans 0 rc 0/0 00010000:00010000:3.0:1788179104.096588:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bc901499e00/0xaa4c98508c498c32 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179104.096593:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 33 00010000:00010000:3.0:1788179104.096595:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bc901499e00/0xaa4c98508c498c32 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.096601:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bc901499e00/0xaa4c98508c498c32 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.096608:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc901499e00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:3.0:1788179104.096612:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bc901499e00/0xaa4c98508c498c32 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.096620:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bc901499e00/0xaa4c98508c498c32 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179104.096906:0:11515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bc901499e00/0xaa4c98508c498c32 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179104.096915:0:11515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bc901499e00/0xaa4c98508c498c32 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.099369:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bc901499e00/0xaa4c98508c498c32 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.099459:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc901499e00/0xaa4c98508c498c32 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.099487:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179104.099562:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+11:2357:x1875041451005440:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 3059us (3265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179104.099574:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 34 00000001:00080000:3.0:1788179104.513545:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967302 is committed 00000004:00080000:3.0:1788179104.513657:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:1.0:1788179104.513922:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472010880:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788179104.514004:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179104.514124:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472010880 00000100:00100000:3.0:1788179104.514132:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472010880 00000100:00100000:3.0:1788179104.514215:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788179104.514225:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472010880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788179104.514256:0:6591:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1788179104.514293:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a95729a, atime: 0x6a95729a, ctime: 0x6a95729a, blocks: 0x1 00010000:00010000:3.0:1788179104.514301:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097497c18/0xaa4c98508c498c39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.514318:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=300s v=(0 0) 00010000:00010000:3.0:1788179104.514323:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788179104.514331:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097497c18/0xaa4c98508c498c39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.514349:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097497c18/0xaa4c98508c498c39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.514691:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097497c18/0xaa4c98508c498c39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.514701:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097497c18/0xaa4c98508c498c39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.514725:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:2.0:1788179104.515956:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:2.0:1788179104.515968:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788179104.516005:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:3.0:1788179104.516425:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1875041472010880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2198us (2416us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788179104.516435:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1788179104.516469:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788179104.516478:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097497c18/0xaa4c98508c498c39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.516490:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc901499e00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:3.0:1788179104.516494:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097497c18/0xaa4c98508c498c39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.516504:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097497c18/0xaa4c98508c498c39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.516523:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097497c18/0xaa4c98508c498c39 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.516530:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097497c18/0xaa4c98508c498c39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179104.516564:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179104.516566:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179104.516567:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788179104.516699:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bc935496a00/2, rc 0, transno 4294967300 00000100:00100000:1.0:1788179104.516707:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472010880:0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1788179104.516726:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788179105.024292:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788179105.473090:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472011008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788179105.473198:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179105.473460:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472011008 00000100:00100000:1.0:1788179105.473470:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472011008 00000100:00100000:1.0:1788179105.473523:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788179105.473533:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875041472011008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788179105.473573:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788179105.473677:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875041472011008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179105.473685:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788179105.473808:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472011008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788179105.610518:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179105.610759:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451005696 00000100:00100000:2.0:1788179105.610770:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451005696 00000100:00100000:2.0:1788179105.610828:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 251 00000100:00100000:2.0:1788179105.610840:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc903538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+11:5572:x1875041451005696:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788179105.610886:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179105.610909:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9136c5400/0xaa4c98508c498c40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x34c7c42474661f85 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179105.610941:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9136c5400/0xaa4c98508c498c40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f85 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179105.610953:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9136c5400/0xaa4c98508c498c40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f85 expref: 12 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179105.610962:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c5400, rc 0) 00000100:00100000:2.0:1788179105.611032:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc903538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+12:5572:x1875041451005696:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 Request processed in 193us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179105.611039:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 251 00000100:00100000:3.0:1788179105.624344:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179105.624770:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451005824 00000100:00100000:0.0:1788179105.624780:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451005824 00000100:00100000:0.0:1788179105.624839:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 252 00000100:00100000:0.0:1788179105.624875:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc903538450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+12:5572:x1875041451005824:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788179105.625741:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc903538450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+12:5572:x1875041451005824:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 Request processed in 889us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179105.625752:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 252 00000100:00100000:1.0:1788179105.628951:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179105.629256:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451005952 00000100:00100000:0.0:1788179105.629268:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451005952 00000100:00100000:0.0:1788179105.629367:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 253 00000100:00100000:0.0:1788179105.629377:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc903538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+12:5572:x1875041451005952:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788179105.629669:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc903538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+12:5572:x1875041451005952:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 Request processed in 292us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179105.629678:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 253 00000100:00100000:3.0:1788179105.643783:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179105.645450:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451006080 00000100:00100000:2.0:1788179105.645467:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451006080 00000100:00100000:2.0:1788179105.645547:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 254 00000100:00100000:2.0:1788179105.645557:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90353b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+12:9923:x1875041451006080:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788179105.646290:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90353b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+12:9923:x1875041451006080:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 730us (2518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179105.646301:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 254 00000100:00100000:0.0:1788179105.669825:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179105.670125:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451006208 00000100:00100000:2.0:1788179105.670145:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451006208 00000100:00100000:2.0:1788179105.670216:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 255 00000100:00100000:2.0:1788179105.670228:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc903539c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+12:9923:x1875041451006208:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788179105.670564:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc903539c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+12:9923:x1875041451006208:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 338us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179105.670572:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 255 00000100:00100000:3.0:1788179105.681443:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179105.686047:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451006336 00000100:00100000:1.0:1788179105.686063:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451006336 00000100:00100000:1.0:1788179105.686280:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 256 00000100:00100000:1.0:1788179105.686292:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+12:5572:x1875041451006336:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788179105.686323:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179105.686346:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc92e12c600/0xaa4c98508c498c47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x34c7c42474661f8c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179105.686378:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc92e12c600/0xaa4c98508c498c47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f8c expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179105.686403:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc92e12c600/0xaa4c98508c498c47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f8c expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179105.686413:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc92e12c600, rc 0) 00000100:00100000:1.0:1788179105.686890:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:5572:x1875041451006336:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 Request processed in 598us (5454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179105.686899:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 256 00000100:00100000:3.0:1788179105.693452:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179105.693653:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451006464 00000100:00100000:0.0:1788179105.693673:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451006464 00000100:00100000:0.0:1788179105.693736:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 257 00000100:00100000:0.0:1788179105.693746:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:5572:x1875041451006464:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788179105.694089:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:5572:x1875041451006464:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 Request processed in 342us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179105.694107:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 257 00000100:00100000:0.0:1788179105.700958:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179105.701063:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451006592 00000100:00100000:2.0:1788179105.701074:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451006592 00000100:00100000:2.0:1788179105.701136:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 258 00000100:00100000:2.0:1788179105.701148:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:5572:x1875041451006592:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788179105.701429:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:5572:x1875041451006592:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 Request processed in 282us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179105.701437:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 258 00000100:00100000:3.0:1788179105.704356:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179105.704473:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451006720 00000100:00100000:1.0:1788179105.704484:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451006720 00000100:00100000:1.0:1788179105.704543:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 259 00000100:00100000:1.0:1788179105.704553:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:9926:x1875041451006720:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788179105.704960:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:9926:x1875041451006720:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 406us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179105.704970:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 259 00000100:00100000:3.0:1788179105.707070:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179105.708232:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451006848 00000100:00100000:0.0:1788179105.708244:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451006848 00000100:00100000:0.0:1788179105.708310:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 260 00000100:00100000:0.0:1788179105.708321:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:9926:x1875041451006848:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788179105.708613:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:9926:x1875041451006848:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 292us (1551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179105.708622:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 260 10000000:01000000:1.0:1788179105.792295:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788179105.792305:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bc902f11000 from 7 10000000:01000000:1.0:1788179105.792311:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788179105.792366:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d200/0xaa4c98508c498c4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179105.792378:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d200/0xaa4c98508c498c4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179105.792407:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d200/0xaa4c98508c498c4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179105.792437:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472011136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788179105.792513:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179105.792588:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc918346d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788179105.792694:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472011136 00000100:00100000:0.0:1788179105.792703:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472011136 00000100:00100000:0.0:1788179105.792774:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788179105.792783:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+16:5793:x1875041472011136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788179105.792798:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179105.792811:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc900031e00/0xaa4c98508c498c55 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c498c4e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179105.792835:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc900031e00/0xaa4c98508c498c55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c498c4e expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179105.792846:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc900031e00/0xaa4c98508c498c55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498c4e expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179105.792886:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc900031e00, rc 0) 00000100:00100000:0.0:1788179105.792941:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+17:5793:x1875041472011136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179105.792948:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788179105.793106:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472011136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788179105.793123:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d200/0xaa4c98508c498c4e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498c55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179105.793131:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d200/0xaa4c98508c498c4e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498c55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179105.793200:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472011264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788179105.793230:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179105.793260:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc918346d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788179105.794504:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472011264 00000100:00100000:0.0:1788179105.794516:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472011264 00000100:00100000:0.0:1788179105.794571:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788179105.794582:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+17:5793:x1875041472011264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788179105.794958:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+17:5793:x1875041472011264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 376us (1724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179105.794966:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788179105.795228:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472011264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788179105.795283:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc90703b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472011392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788179105.795337:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179105.795358:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472011392 00000100:00100000:2.0:1788179105.795363:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472011392 00000100:00100000:3.0:1788179105.795370:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc910967f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788179105.795395:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788179105.795403:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+17:5793:x1875041472011392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788179105.795565:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+17:5793:x1875041472011392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179105.795571:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788179105.795819:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc90703b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472011392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788179105.796569:0:11530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc90703b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:11530:1875041472011520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788179105.796614:0:11530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179105.796654:0:11530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc910967180 going to sleep for 11 seconds 00000100:00100000:0.0:1788179105.796719:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472011520 00000100:00100000:0.0:1788179105.796736:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472011520 00000100:00100000:0.0:1788179105.796775:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788179105.796783:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+17:11530:x1875041472011520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788179105.796975:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+17:11530:x1875041472011520:12345-0@lo:502:llog_process_th.0 Request processed in 192us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179105.796982:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788179105.797083:0:11530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc90703b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:11530:1875041472011520:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788179105.797107:0:11530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788179105.797116:0:11530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788179105.797118:0:11530:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788179105.797124:0:11530:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bc902f11000 00000020:00000080:3.0:1788179105.797127:0:11530:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788179105.797221:0:11530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc90703b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:11530:1875041472011648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788179105.797257:0:11530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179105.797276:0:11530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc910967180 going to sleep for 11 seconds 00000100:00100000:0.0:1788179105.799321:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472011648 00000100:00100000:0.0:1788179105.799335:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472011648 00000100:00100000:0.0:1788179105.799375:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788179105.799383:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+17:11530:x1875041472011648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788179105.799620:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+17:11530:x1875041472011648:12345-0@lo:502:llog_process_th.0 Request processed in 236us (2361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179105.799628:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788179105.801671:0:11530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc90703b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:11530:1875041472011648:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788179105.801714:0:11530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788179105.801723:0:11530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788179105.801736:0:11530:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788179105.801741:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788179105.801975:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788179105.802000:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788179105.802011:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d200/0xaa4c98508c498c4e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498c55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179105.802023:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d200/0xaa4c98508c498c4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498c55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788179105.802033:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788179105.802036:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bc913608800 from 7 10000000:01000000:1.0:1788179105.802039:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788179105.802091:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c800/0xaa4c98508c498c5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179105.802099:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c800/0xaa4c98508c498c5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179105.802109:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c800/0xaa4c98508c498c5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179105.802129:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472011776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788179105.802193:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179105.802237:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc918346d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788179105.802256:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472011776 00000100:00100000:1.0:1788179105.802262:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472011776 00000100:00100000:1.0:1788179105.802293:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788179105.802302:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+17:5793:x1875041472011776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788179105.802314:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179105.802326:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc92e12ca00/0xaa4c98508c498c63 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c498c5c expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179105.802348:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc92e12ca00/0xaa4c98508c498c63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c498c5c expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179105.802358:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc92e12ca00/0xaa4c98508c498c63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498c5c expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179105.802367:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc92e12ca00, rc 0) 00000100:00100000:1.0:1788179105.802401:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041472011776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179105.802408:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788179105.802455:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472011776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788179105.802469:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c800/0xaa4c98508c498c5c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498c63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179105.802478:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c800/0xaa4c98508c498c5c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498c63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179105.802522:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472011904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788179105.802546:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179105.802560:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc918346d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788179105.802571:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472011904 00000100:00100000:1.0:1788179105.802574:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472011904 00000100:00100000:1.0:1788179105.802589:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788179105.802595:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041472011904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788179105.802841:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041472011904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179105.802881:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788179105.802913:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472011904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788179105.802940:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472012032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788179105.802992:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179105.803010:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93fad9300 going to sleep for 11 seconds 00000100:00100000:1.0:1788179105.803021:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472012032 00000100:00100000:1.0:1788179105.803024:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472012032 00000100:00100000:1.0:1788179105.803041:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788179105.803047:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041472012032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788179105.803178:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041472012032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179105.803199:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788179105.803240:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472012032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788179105.804007:0:11532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:11532:1875041472012160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788179105.804049:0:11532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179105.804091:0:11532:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93fad9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788179105.804195:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472012160 00000100:00100000:2.0:1788179105.804201:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472012160 00000100:00100000:2.0:1788179105.804239:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788179105.804246:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+18:11532:x1875041472012160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788179105.804421:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+18:11532:x1875041472012160:12345-0@lo:502:llog_process_th.0 Request processed in 175us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179105.804437:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788179105.804529:0:11532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:11532:1875041472012160:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788179105.804553:0:11532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788179105.804563:0:11532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788179105.804566:0:11532:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788179105.804574:0:11532:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bc913608800 00000020:00000080:1.0:1788179105.804577:0:11532:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788179105.804650:0:11532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:11532:1875041472012288:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788179105.804684:0:11532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179105.804711:0:11532:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93fad9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788179105.804887:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472012288 00000100:00100000:2.0:1788179105.804892:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472012288 00000100:00100000:2.0:1788179105.804917:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788179105.804923:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+18:11532:x1875041472012288:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788179105.805054:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+18:11532:x1875041472012288:12345-0@lo:502:llog_process_th.0 Request processed in 131us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179105.805075:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788179105.805223:0:11532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:11532:1875041472012288:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788179105.805241:0:11532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788179105.805246:0:11532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788179105.805248:0:11532:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788179105.805252:0:11532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788179105.805950:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788179105.805973:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788179105.805983:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c800/0xaa4c98508c498c5c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498c63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179105.805994:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c800/0xaa4c98508c498c5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498c63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788179105.806004:0:5793:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788179105.806006:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bc9070e2800 from 7 10000000:01000000:2.0:1788179105.806009:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788179105.806036:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4c00/0xaa4c98508c498c6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179105.806044:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4c00/0xaa4c98508c498c6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179105.806053:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4c00/0xaa4c98508c498c6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179105.806144:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935495c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472012416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788179105.806203:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179105.806241:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9266da000 going to sleep for 11 seconds 00000100:00100000:1.0:1788179105.806299:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472012416 00000100:00100000:1.0:1788179105.806305:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472012416 00000100:00100000:1.0:1788179105.806345:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788179105.806354:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+18:5793:x1875041472012416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788179105.806363:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179105.806376:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc92e12c000/0xaa4c98508c498c71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c498c6a expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179105.806405:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc92e12c000/0xaa4c98508c498c71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c498c6a expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179105.806416:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc92e12c000/0xaa4c98508c498c71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c498c6a expref: 19 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179105.806424:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc92e12c000, rc 0) 00000100:00100000:1.0:1788179105.806473:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:5793:x1875041472012416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179105.806479:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788179105.808030:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935495c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472012416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788179105.808056:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4c00/0xaa4c98508c498c6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498c71 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179105.808141:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4c00/0xaa4c98508c498c6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498c71 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179105.808225:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc90703b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472012544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788179105.808278:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179105.808318:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc910967180 going to sleep for 11 seconds 00000100:00100000:1.0:1788179105.808367:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472012544 00000100:00100000:1.0:1788179105.808374:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472012544 00000100:00100000:1.0:1788179105.808407:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788179105.808415:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+19:5793:x1875041472012544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788179105.808681:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+19:5793:x1875041472012544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179105.808688:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788179105.809668:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc90703b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472012544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788179105.809710:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc90703b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472012672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788179105.809869:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179105.809901:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc910967180 going to sleep for 11 seconds 00000100:00100000:2.0:1788179105.809951:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472012672 00000100:00100000:2.0:1788179105.809957:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472012672 00000100:00100000:2.0:1788179105.809995:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788179105.810004:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:5793:x1875041472012672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788179105.810253:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:5793:x1875041472012672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 250us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179105.810260:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788179105.810260:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc90703b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efc6f743-3303-46d5-8807-513b82cac1cc:5793:1875041472012672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788179105.824068:0:11534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935497100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:11534:1875041472012800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788179105.824170:0:11534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179105.824232:0:11534:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9266da0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788179105.824294:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472012800 00000100:00100000:0.0:1788179105.824307:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472012800 00000100:00100000:0.0:1788179105.824364:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788179105.824373:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:11534:x1875041472012800:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788179105.824608:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:11534:x1875041472012800:12345-0@lo:502:llog_process_th.0 Request processed in 236us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179105.824617:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788179105.824775:0:11534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935497100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:11534:1875041472012800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788179105.824816:0:11534:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788179105.824829:0:11534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788179105.824832:0:11534:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788179105.824839:0:11534:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bc9070e2800 00000020:00000080:2.0:1788179105.824842:0:11534:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788179105.824943:0:11534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935497100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:11534:1875041472012928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788179105.824979:0:11534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179105.824996:0:11534:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9266da0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788179105.825570:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472012928 00000100:00100000:2.0:1788179105.825579:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472012928 00000100:00100000:2.0:1788179105.825622:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788179105.825629:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+19:11534:x1875041472012928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788179105.825801:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+19:11534:x1875041472012928:12345-0@lo:502:llog_process_th.0 Request processed in 172us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179105.825822:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788179105.825898:0:11534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935497100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efc6f743-3303-46d5-8807-513b82cac1cc:11534:1875041472012928:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788179105.825928:0:11534:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788179105.825934:0:11534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788179105.825936:0:11534:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788179105.825940:0:11534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000040:00080000:1.0:1788179105.827205:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:3.0:1788179105.828140:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788179105.828166:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788179105.828178:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4c00/0xaa4c98508c498c6a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498c71 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179105.828212:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4c00/0xaa4c98508c498c6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498c71 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179106.048002:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179106.497562:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041472013312:0@lo:400:kworker.0 00000100:00100000:3.0:1788179106.497637:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179106.497708:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788179106.497715:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472013440:0@lo:400:kworker.0 00000100:00100000:3.0:1788179106.497744:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179106.497818:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875041472013184:0@lo:400:kworker.0 00000100:00100000:2.0:1788179106.497883:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179106.497904:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472013696:0@lo:400:kworker.0 00000100:00100000:2.0:1788179106.497928:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179106.497949:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788179106.497955:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041472013056:0@lo:400:kworker.0 00000100:00100000:2.0:1788179106.497984:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179106.498007:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041472013568:0@lo:400:kworker.0 00000100:00100000:2.0:1788179106.498040:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179106.498076:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472013440 00000100:00100000:2.0:1788179106.498085:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472013440 00000100:00100000:2.0:1788179106.498150:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472013696 00000100:00100000:2.0:1788179106.498154:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472013696 00000100:00100000:2.0:1788179106.498186:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788179106.498198:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875041472013440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179106.498255:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875041472013440:12345-0@lo:400:kworker.0 Request processed in 58us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179106.498262:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788179106.498278:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788179106.498298:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472013696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179106.498330:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472013696:12345-0@lo:400:kworker.0 Request processed in 33us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179106.498336:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788179106.498471:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472013056 00000100:00100000:2.0:1788179106.498476:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472013056 00000100:00100000:2.0:1788179106.498500:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788179106.498506:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:3308:x1875041472013056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179106.498535:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:3308:x1875041472013056:12345-0@lo:400:kworker.0 Request processed in 30us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179106.498542:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788179106.498568:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472013312 00000100:00100000:2.0:1788179106.498571:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472013312 00000100:00100000:2.0:1788179106.498596:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472013184 00000100:00100000:2.0:1788179106.498599:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472013184 00000100:00100000:2.0:1788179106.498609:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472013568 00000100:00100000:2.0:1788179106.498611:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472013568 00000100:00100000:2.0:1788179106.498626:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788179106.498632:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041472013312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179106.498661:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041472013312:12345-0@lo:400:kworker.0 Request processed in 30us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179106.498668:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788179106.498679:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788179106.498684:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875041472013184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179106.498709:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875041472013184:12345-0@lo:400:kworker.0 Request processed in 25us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179106.498715:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788179106.498748:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788179106.498754:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041472013568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179106.498783:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041472013568:12345-0@lo:400:kworker.0 Request processed in 29us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179106.498788:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1788179106.498804:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788179106.498808:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788179106.498810:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788179106.498846:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472013440:0@lo:400:kworker.0 00000100:00100000:2.0:1788179106.498887:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041472013312:0@lo:400:kworker.0 00000100:00100000:2.0:1788179106.498916:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041472013056:0@lo:400:kworker.0 00000100:00100000:2.0:1788179106.498925:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041472013568:0@lo:400:kworker.0 00000100:00100000:2.0:1788179106.498933:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875041472013184:0@lo:400:kworker.0 00010000:00080000:2.0:1788179106.498944:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8d8700 x1875041472013696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179106.498953:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472013696:0@lo:400:kworker.0 00000040:00080000:2.0:1788179106.882774:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788179107.008245:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472013824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788179107.008320:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179107.008672:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472013824 00000100:00100000:2.0:1788179107.008681:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472013824 00000100:00100000:2.0:1788179107.008745:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788179107.008754:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472013824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788179107.008787:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179107.008844:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472013824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179107.008892:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1788179107.008975:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc935494e00 x1875041472013824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179123 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179107.008994:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472013824:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788179107.072034:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179107.976393:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179107.976547:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451006976 00000100:00100000:2.0:1788179107.976559:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451006976 00000100:00100000:2.0:1788179107.976630:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 277 00000100:00100000:2.0:1788179107.976641:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2356:x1875041451006976:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788179107.976746:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2356:x1875041451006976:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 106us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179107.976753:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 277 00000100:00100000:3.0:1788179107.978010:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179107.978052:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179107.978091:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179107.978330:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451007104 00000100:00100000:1.0:1788179107.978340:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451007104 00000100:00100000:1.0:1788179107.978397:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451007360 00000100:00100000:1.0:1788179107.978400:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451007360 00000100:00100000:1.0:1788179107.978425:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 107 00000100:00100000:1.0:1788179107.978434:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2356:x1875041451007104:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179107.978493:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2356:x1875041451007104:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 59us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179107.978534:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 107 00000100:00100000:1.0:1788179107.978554:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 108 00000100:00100000:1.0:1788179107.978562:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90703bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2356:x1875041451007360:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179107.978592:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90703bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2356:x1875041451007360:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 31us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179107.978597:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 108 00000100:00080000:3.0:1788179107.978930:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788179107.980208:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451007232 00000100:00100000:2.0:1788179107.980228:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451007232 00000100:00100000:2.0:1788179107.980320:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:2.0:1788179107.980331:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90703b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2356:x1875041451007232:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788179107.980419:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90703b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2356:x1875041451007232:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 91us (2414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179107.980427:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00080000:3.0:1788179107.982082:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788179108.098241:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179109.120151:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788179109.648603:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:2.0:1788179110.144210:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788179110.592540:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472013952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788179110.592609:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179110.592783:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472013952 00000100:00100000:1.0:1788179110.592791:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472013952 00000100:00100000:1.0:1788179110.592988:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788179110.592999:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472013952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788179110.593034:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788179110.593084:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472013952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179110.593091:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788179110.593128:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1788179110.593134:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bc935496a00, transno 4294967300 00000100:00080000:2.0:1788179110.593398:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788179110.593757:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472013952:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788179111.168473:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179111.616904:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041472014336:0@lo:400:kworker.0 00000100:00100000:1.0:1788179111.616972:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179111.617045:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788179111.617052:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472014464:0@lo:400:kworker.0 00000100:00100000:1.0:1788179111.617078:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179111.617112:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472014464 00000100:00100000:1.0:1788179111.617144:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472014464 00000100:00100000:1.0:1788179111.617190:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788179111.617199:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472014464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179111.617250:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472014464:12345-0@lo:400:kworker.0 Request processed in 52us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179111.617256:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788179111.617301:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472014464:0@lo:400:kworker.0 00000100:00100000:3.0:1788179111.617378:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472014080:0@lo:400:kworker.0 00000100:00100000:3.0:1788179111.617410:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179111.617443:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041472014592:0@lo:400:kworker.0 00000100:00100000:3.0:1788179111.617464:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179111.617490:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788179111.617496:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041472014208:0@lo:400:kworker.0 00000100:00100000:3.0:1788179111.617517:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179111.617533:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472014720:0@lo:400:kworker.0 00000100:00100000:3.0:1788179111.617552:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179111.617578:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472014336 00000100:00100000:3.0:1788179111.617582:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472014336 00000100:00100000:3.0:1788179111.617615:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472014592 00000100:00100000:3.0:1788179111.617618:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472014592 00000100:00100000:3.0:1788179111.617632:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472014208 00000100:00100000:3.0:1788179111.617635:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472014208 00000100:00100000:3.0:1788179111.617648:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788179111.617653:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041472014336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179111.617689:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041472014336:12345-0@lo:400:kworker.0 Request processed in 36us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179111.617695:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788179111.617708:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788179111.617714:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90703b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875041472014592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179111.617744:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90703b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875041472014592:12345-0@lo:400:kworker.0 Request processed in 30us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179111.617749:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788179111.617759:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788179111.617765:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90703b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041472014208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179111.617790:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90703b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041472014208:12345-0@lo:400:kworker.0 Request processed in 25us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179111.617795:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788179111.617814:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472014720 00000100:00100000:3.0:1788179111.617823:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472014720 00000100:00100000:3.0:1788179111.617875:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788179111.617882:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90703a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472014720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179111.617911:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90703a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472014720:12345-0@lo:400:kworker.0 Request processed in 30us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179111.617916:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1788179111.617937:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788179111.617941:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788179111.617959:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041472014208:0@lo:400:kworker.0 00010000:00080000:3.0:1788179111.617972:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e0c6300 x1875041472014720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179111.617982:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472014720:0@lo:400:kworker.0 00000100:00100000:3.0:1788179111.617992:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041472014592:0@lo:400:kworker.0 00000100:00100000:3.0:1788179111.618016:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041472014336:0@lo:400:kworker.0 00000100:00100000:1.0:1788179111.618284:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472014080 00000100:00100000:1.0:1788179111.618288:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472014080 00000100:00100000:1.0:1788179111.618323:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788179111.618329:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+19:3307:x1875041472014080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179111.618374:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+19:3307:x1875041472014080:12345-0@lo:400:kworker.0 Request processed in 45us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179111.618379:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788179111.618925:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472014080:0@lo:400:kworker.0 00000100:00100000:3.0:1788179112.128283:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472014848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788179112.128356:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179112.128549:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472014848 00000100:00100000:2.0:1788179112.128558:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472014848 00000100:00100000:2.0:1788179112.128609:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788179112.128618:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472014848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788179112.128652:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179112.128717:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472014848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179112.128724:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1788179112.129175:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc935496a00 x1875041472014848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179128 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179112.129196:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472014848:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788179112.192878:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179113.096009:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179113.096053:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179113.096199:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179113.096239:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179113.096270:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451007744 00000100:00100000:1.0:1788179113.096280:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451007744 00000100:00100000:1.0:1788179113.096340:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 64 00000100:00100000:1.0:1788179113.096350:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2355:x1875041451007744:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179113.096424:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2355:x1875041451007744:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 76us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179113.096433:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 64 00000100:00080000:1.0:1788179113.096560:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788179113.096732:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451007488 00000100:00100000:2.0:1788179113.096738:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451007488 00000100:00100000:2.0:1788179113.096775:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 279 00000100:00100000:2.0:1788179113.096783:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc920153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2355:x1875041451007488:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788179113.096821:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc920153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2355:x1875041451007488:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 39us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179113.096828:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 279 00000100:00100000:0.0:1788179113.097168:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451007616 00000100:00100000:0.0:1788179113.097173:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451007616 00000100:00100000:0.0:1788179113.097252:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451007872 00000100:00100000:0.0:1788179113.097256:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451007872 00000100:00100000:2.0:1788179113.097301:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 112 00000100:00100000:2.0:1788179113.097309:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2355:x1875041451007616:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788179113.097349:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2355:x1875041451007616:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 41us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179113.097356:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 112 00000100:00080000:1.0:1788179113.097692:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788179113.097788:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 113 00000100:00100000:0.0:1788179113.097795:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2355:x1875041451007872:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179113.097837:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2355:x1875041451007872:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 42us (1783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179113.097843:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 113 00010000:00010000:1.0:1788179113.218962:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179114.240046:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179115.264232:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179115.712322:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788179115.712347:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472014976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788179115.712434:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179115.712690:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472014976 00000100:00100000:1.0:1788179115.712699:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472014976 00000100:00100000:1.0:1788179115.712761:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788179115.712771:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472014976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788179115.712805:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788179115.712909:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788179115.713037:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472014976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 267us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179115.713044:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788179115.714196:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472014976:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788179116.097272:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788179116.288473:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179116.736916:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041472015360:0@lo:400:kworker.0 00000100:00100000:1.0:1788179116.736983:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179116.737052:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788179116.737059:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472015488:0@lo:400:kworker.0 00000100:00100000:1.0:1788179116.737102:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179116.737133:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472015488 00000100:00100000:1.0:1788179116.737140:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472015488 00000100:00100000:1.0:1788179116.737181:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788179116.737188:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472015488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179116.737231:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472015488:12345-0@lo:400:kworker.0 Request processed in 43us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179116.737238:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788179116.737274:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472015488:0@lo:400:kworker.0 00000100:00100000:0.0:1788179116.737512:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472015104:0@lo:400:kworker.0 00000100:00100000:0.0:1788179116.737544:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179116.737573:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041472015616:0@lo:400:kworker.0 00000100:00100000:0.0:1788179116.737592:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179116.737610:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788179116.737615:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041472015232:0@lo:400:kworker.0 00000100:00100000:0.0:1788179116.737632:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179116.737643:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472015744:0@lo:400:kworker.0 00000100:00100000:0.0:1788179116.737671:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179116.737691:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472015360 00000100:00100000:0.0:1788179116.737695:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472015360 00000100:00100000:0.0:1788179116.737727:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472015616 00000100:00100000:0.0:1788179116.737730:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472015616 00000100:00100000:0.0:1788179116.737743:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472015232 00000100:00100000:0.0:1788179116.737745:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472015232 00000100:00100000:0.0:1788179116.737756:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788179116.737762:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041472015360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179116.737795:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041472015360:12345-0@lo:400:kworker.0 Request processed in 33us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179116.737801:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788179116.737817:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788179116.737823:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875041472015616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179116.737878:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875041472015616:12345-0@lo:400:kworker.0 Request processed in 55us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179116.737885:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788179116.737897:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788179116.737903:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041472015232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179116.737927:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041472015232:12345-0@lo:400:kworker.0 Request processed in 25us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179116.737932:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:0.0:1788179116.737949:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788179116.737968:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041472015232:0@lo:400:kworker.0 00000100:00100000:0.0:1788179116.737978:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041472015616:0@lo:400:kworker.0 00000100:00100000:1.0:1788179116.738047:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472015104 00000100:00100000:1.0:1788179116.738051:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472015104 00000100:00100000:1.0:1788179116.738094:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788179116.738101:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:3307:x1875041472015104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179116.738144:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:3307:x1875041472015104:12345-0@lo:400:kworker.0 Request processed in 44us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179116.738150:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788179116.738175:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472015744 00000100:00100000:1.0:1788179116.738179:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472015744 00000100:00100000:1.0:1788179116.738208:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788179116.738214:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472015744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179116.738242:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472015744:12345-0@lo:400:kworker.0 Request processed in 28us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179116.738248:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1788179116.738264:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788179116.738283:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93f7f3480 x1875041472015744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788179116.738294:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472015744:0@lo:400:kworker.0 00000100:00100000:1.0:1788179116.738303:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472015104:0@lo:400:kworker.0 00000100:00100000:1.0:1788179116.738327:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041472015360:0@lo:400:kworker.0 00000100:00100000:3.0:1788179117.248185:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788179117.248208:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472015872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788179117.248285:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179117.248616:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472015872 00000100:00100000:0.0:1788179117.248649:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472015872 00000100:00100000:0.0:1788179117.248804:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788179117.248815:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472015872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788179117.248876:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788179117.248933:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472015872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179117.248940:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1788179117.249027:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc935494e00 x1875041472015872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179133 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179117.249046:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472015872:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788179117.311981:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788179118.217519:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179118.217563:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179118.217602:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179118.217638:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179118.217722:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451008000 00000100:00100000:1.0:1788179118.217733:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451008000 00000100:00100000:1.0:1788179118.217794:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 281 00000100:00100000:1.0:1788179118.217805:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2357:x1875041451008000:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179118.217913:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2357:x1875041451008000:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 109us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179118.217921:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 281 00000100:00100000:1.0:1788179118.217969:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451008256 00000100:00100000:1.0:1788179118.217973:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451008256 00000100:00100000:1.0:1788179118.218019:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 67 00000100:00100000:1.0:1788179118.218026:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2357:x1875041451008256:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179118.218056:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2357:x1875041451008256:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 30us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179118.218062:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 67 00000100:00080000:1.0:1788179118.218115:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788179118.218652:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451008128 00000100:00100000:0.0:1788179118.218657:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451008128 00000100:00100000:0.0:1788179118.218703:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451008384 00000100:00100000:0.0:1788179118.218706:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451008384 00000100:00100000:0.0:1788179118.218727:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 117 00000100:00100000:0.0:1788179118.218734:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2357:x1875041451008128:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179118.218778:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2357:x1875041451008128:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 45us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179118.218783:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 117 00000100:00100000:0.0:1788179118.218799:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 118 00000100:00100000:0.0:1788179118.218805:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2357:x1875041451008384:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179118.218825:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2357:x1875041451008384:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 21us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179118.218831:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 118 00000100:00080000:1.0:1788179118.219547:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788179118.336054:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179119.360194:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179120.384395:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179120.832434:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472016000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788179120.832512:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179120.832630:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472016000 00000100:00100000:1.0:1788179120.832639:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472016000 00000100:00080000:0.0:1788179120.837133:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788179120.837408:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788179120.837431:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472016000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788179120.837477:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788179120.837575:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472016000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (5063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179120.837581:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788179120.837695:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472016000:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788179121.411310:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179121.856787:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472016512:0@lo:400:kworker.0 00000100:00100000:3.0:1788179121.856881:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179121.856939:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788179121.856945:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875041472016384:0@lo:400:kworker.0 00000100:00100000:3.0:1788179121.856970:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179121.857334:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472016384 00000100:00100000:0.0:1788179121.857343:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472016384 00000100:00100000:0.0:1788179121.857408:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788179121.857418:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875041472016384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179121.857475:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875041472016384:12345-0@lo:400:kworker.0 Request processed in 58us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179121.857489:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788179121.857542:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875041472016384:0@lo:400:kworker.0 00000100:00080000:3.0:1788179121.857611:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788179121.857693:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472016128:0@lo:400:kworker.0 00000100:00100000:1.0:1788179121.857725:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179121.857759:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041472016640:0@lo:400:kworker.0 00000100:00100000:1.0:1788179121.857781:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179121.857806:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788179121.857813:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041472016256:0@lo:400:kworker.0 00000100:00100000:1.0:1788179121.857833:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179121.857866:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472016768:0@lo:400:kworker.0 00000100:00100000:1.0:1788179121.857899:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179121.857926:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472016512 00000100:00100000:1.0:1788179121.857930:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472016512 00000100:00100000:1.0:1788179121.857956:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472016768 00000100:00100000:1.0:1788179121.857960:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472016768 00000100:00100000:1.0:1788179121.857981:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788179121.857987:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472016512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179121.858026:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472016512:12345-0@lo:400:kworker.0 Request processed in 39us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179121.858043:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788179121.858056:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788179121.858062:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472016768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179121.858092:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472016768:12345-0@lo:400:kworker.0 Request processed in 31us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179121.858098:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1788179121.858179:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788179121.858802:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc93b612a00 x1875041472016768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788179121.858818:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472016768:0@lo:400:kworker.0 00000100:00100000:1.0:1788179121.858898:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472016512:0@lo:400:kworker.0 00000100:00100000:0.0:1788179121.858988:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472016128 00000100:00100000:0.0:1788179121.858995:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472016128 00000100:00100000:0.0:1788179121.859045:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788179121.859053:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:3307:x1875041472016128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179121.859110:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:3307:x1875041472016128:12345-0@lo:400:kworker.0 Request processed in 58us (1384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179121.859116:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788179121.859159:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472016128:0@lo:400:kworker.0 00000100:00100000:3.0:1788179121.859874:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472016640 00000100:00100000:3.0:1788179121.859882:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472016640 00000100:00100000:3.0:1788179121.859934:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472016256 00000100:00100000:3.0:1788179121.859937:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472016256 00000100:00100000:3.0:1788179121.859959:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788179121.859967:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875041472016640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179121.860021:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875041472016640:12345-0@lo:400:kworker.0 Request processed in 55us (2238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179121.860050:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788179121.860066:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788179121.860072:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041472016256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179121.860101:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041472016256:12345-0@lo:400:kworker.0 Request processed in 30us (2267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179121.860108:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1788179121.860339:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788179121.860412:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041472016256:0@lo:400:kworker.0 00000100:00100000:0.0:1788179121.860425:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041472016640:0@lo:400:kworker.0 00000100:00100000:1.0:1788179122.368257:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788179122.368288:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472016896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788179122.368369:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179122.368561:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472016896 00000100:00100000:2.0:1788179122.368585:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472016896 00000100:00100000:2.0:1788179122.368643:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788179122.368652:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472016896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788179122.368687:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179122.368787:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472016896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179122.368794:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1788179122.377796:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc935494e00 x1875041472016896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179138 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788179122.378285:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472016896:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788179122.432120:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788179123.341950:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179123.342000:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179123.342089:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451008640 00000100:00100000:3.0:1788179123.342099:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451008640 00000100:00100000:3.0:1788179123.342188:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 122 00000100:00100000:3.0:1788179123.342198:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2354:x1875041451008640:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788179123.342282:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2354:x1875041451008640:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 86us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179123.342290:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 122 00000100:00100000:1.0:1788179123.342875:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451008512 00000100:00100000:1.0:1788179123.342882:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451008512 00000100:00100000:1.0:1788179123.342923:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 283 00000100:00100000:1.0:1788179123.342930:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2354:x1875041451008512:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179123.342974:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2354:x1875041451008512:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 44us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179123.342981:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 283 00000100:00080000:2.0:1788179123.343877:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788179123.365454:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179123.365950:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451008768 00000100:00100000:1.0:1788179123.365960:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451008768 00000100:00100000:1.0:1788179123.366050:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:1.0:1788179123.366060:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2353:x1875041451008768:12345-192.168.202.2@tcp:9:kworker.0 00000020:00000080:1.0:1788179123.366095:0:7778:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c498bad 00000100:00080000:1.0:1788179123.366103:0:7778:0:(import.c:65:import_set_state_nolock()) ffff9bc9359e3800 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1788179123.366480:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:1.0:1788179123.366545:0:7778:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:0.0:1788179123.366637:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179123.366956:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+2:2353:x1875041451008768:12345-192.168.202.2@tcp:9:kworker.0 Request processed in 894us (1510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179123.366964:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:3.0:1788179123.375748:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179123.375939:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451008896 00000100:00100000:0.0:1788179123.375950:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451008896 00000100:00100000:0.0:1788179123.376038:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 123 00000100:00080000:2.0:1788179123.376049:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788179123.376049:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2354:x1875041451008896:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179123.376130:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2354:x1875041451008896:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 83us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179123.376138:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 123 00010000:00010000:3.0:1788179123.457312:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179124.480340:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788179125.026130:0:6618:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 334bb25c-6762-4beb-8a84-3a838cbc7e80 00000020:00000080:2.0:1788179125.026139:0:6618:0:(genops.c:907:class_export_put()) final put ffff9bc9359e7000/334bb25c-6762-4beb-8a84-3a838cbc7e80 00000020:00000080:0.0:1788179125.026263:0:471:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc9359e7000/334bb25c-6762-4beb-8a84-3a838cbc7e80 for lustre-OST0000 00000020:00000080:0.0:1788179125.026321:0:471:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9bc9359e3800 for lustre-OST0000 00010000:00010000:2.0:1788179125.504170:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179125.952529:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472017024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788179125.952670:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179125.955436:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472017024 00000100:00100000:2.0:1788179125.955450:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472017024 00000100:00100000:2.0:1788179125.955534:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788179125.955545:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472017024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788179125.955599:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788179125.955687:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788179125.959103:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472017024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3550us (6422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179125.959119:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788179125.959471:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472017024:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788179126.341431:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788179126.529311:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179126.977382:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472017536:0@lo:400:kworker.0 00000100:00100000:0.0:1788179126.977459:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179126.977528:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788179126.977534:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875041472017408:0@lo:400:kworker.0 00000100:00100000:0.0:1788179126.977559:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179126.977595:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472017536 00000100:00100000:0.0:1788179126.977602:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472017536 00000100:00100000:0.0:1788179126.977647:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788179126.977656:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472017536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179126.977705:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472017536:12345-0@lo:400:kworker.0 Request processed in 51us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179126.977711:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788179126.977751:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472017536:0@lo:400:kworker.0 00000100:00100000:2.0:1788179126.977893:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472017152:0@lo:400:kworker.0 00000100:00100000:2.0:1788179126.977927:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179126.977975:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041472017664:0@lo:400:kworker.0 00000100:00100000:2.0:1788179126.978012:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179126.978029:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788179126.978034:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041472017280:0@lo:400:kworker.0 00000100:00100000:2.0:1788179126.978080:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179126.978098:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472017792:0@lo:400:kworker.0 00000100:00100000:2.0:1788179126.978117:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179126.978321:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472017408 00000100:00100000:3.0:1788179126.978327:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472017408 00000100:00100000:3.0:1788179126.978377:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472017664 00000100:00100000:3.0:1788179126.978380:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472017664 00000100:00100000:3.0:1788179126.978394:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472017280 00000100:00100000:3.0:1788179126.978396:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472017280 00000100:00100000:3.0:1788179126.978408:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788179126.978415:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875041472017408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179126.978461:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875041472017408:12345-0@lo:400:kworker.0 Request processed in 47us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179126.978476:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788179126.978491:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788179126.978496:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875041472017664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179126.978535:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875041472017664:12345-0@lo:400:kworker.0 Request processed in 39us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179126.978541:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788179126.978552:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788179126.978558:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041472017280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179126.978584:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041472017280:12345-0@lo:400:kworker.0 Request processed in 27us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179126.978589:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788179126.978610:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472017792 00000100:00100000:3.0:1788179126.978613:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472017792 00000100:00100000:3.0:1788179126.978638:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788179126.978645:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472017792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179126.978676:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472017792:12345-0@lo:400:kworker.0 Request processed in 32us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179126.978681:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788179126.978717:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041472017280:0@lo:400:kworker.0 00010000:00080000:3.0:1788179126.978731:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc9358fa300 x1875041472017792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179126.978740:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472017792:0@lo:400:kworker.0 00000100:00100000:3.0:1788179126.978749:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041472017664:0@lo:400:kworker.0 00000100:00080000:2.0:1788179126.978826:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788179126.978831:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788179126.979035:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472017152 00000100:00100000:0.0:1788179126.979040:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472017152 00000100:00100000:0.0:1788179126.979171:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788179126.979179:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+19:3307:x1875041472017152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179126.979348:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875041472017408:0@lo:400:kworker.0 00000100:00100000:0.0:1788179126.979421:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+19:3307:x1875041472017152:12345-0@lo:400:kworker.0 Request processed in 243us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179126.979428:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788179126.981037:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472017152:0@lo:400:kworker.0 00000100:00100000:3.0:1788179127.488514:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc906227100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472017920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788179127.488609:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179127.488780:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472017920 00000100:00100000:2.0:1788179127.488790:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472017920 00000100:00100000:2.0:1788179127.488867:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788179127.488878:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b612300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472017920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788179127.488913:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179127.488962:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b612300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472017920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179127.488969:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1788179127.490454:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc906227100 x1875041472017920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179143 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179127.490479:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc906227100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472017920:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788179127.553015:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788179128.361462:0:11699:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 08:25:25 (1788179125) 00000100:00100000:3.0:1788179128.456580:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179128.456613:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179128.456631:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179128.456654:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451009024 00000100:00100000:3.0:1788179128.456663:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451009024 00000100:00100000:3.0:1788179128.456708:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 285 00000100:00100000:3.0:1788179128.456716:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2355:x1875041451009024:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788179128.456774:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2355:x1875041451009024:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 60us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179128.456781:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 285 00000100:00100000:3.0:1788179128.456809:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451009280 00000100:00100000:3.0:1788179128.456812:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451009280 00000100:00100000:3.0:1788179128.456838:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451009152 00000100:00100000:3.0:1788179128.456839:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451009152 00000100:00100000:3.0:1788179128.456875:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 127 00000100:00100000:3.0:1788179128.456898:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2355:x1875041451009280:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788179128.456937:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2355:x1875041451009280:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 31us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179128.456943:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 127 00000100:00100000:3.0:1788179128.456954:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 128 00000100:00100000:3.0:1788179128.456967:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2355:x1875041451009152:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788179128.457004:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2355:x1875041451009152:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 37us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179128.457010:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 128 00000100:00080000:2.0:1788179128.457842:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788179128.576305:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179129.600112:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179130.394513:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179130.394611:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451009408 00000100:00100000:3.0:1788179130.394621:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451009408 00000100:00100000:3.0:1788179130.394759:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00100000:3.0:1788179130.394772:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:10194:x1875041451009408:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788179130.394791:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179130.394814:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498c78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474661f93 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.394918:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498c7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.394932:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498c7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.394944:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498c7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179130.397492:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788179130.397503:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788179130.397695:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498c7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.397735:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498c78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f93 expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.397768:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498c7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f93 expref: 6 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.397777:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc903312000) 00010000:00010000:3.0:1788179130.397780:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788179130.397784:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc901499e00, rc 0) 00000100:00100000:3.0:1788179130.398839:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:10194:x1875041451009408:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 4063us (4326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179130.399060:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00080000:2.0:1788179130.399602:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788179130.415334:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179130.415481:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451009536 00000100:00100000:3.0:1788179130.415492:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451009536 00000100:00100000:3.0:1788179130.415554:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:3.0:1788179130.415564:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:10195:x1875041451009536:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788179130.415582:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179130.415602:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498c86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474661f9a expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.415697:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498c8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.415712:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498c8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.415721:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498c8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.415735:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499600/0xaa4c98508c498c94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.415749:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499600/0xaa4c98508c498c94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.415756:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499600/0xaa4c98508c498c94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.416803:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499200/0xaa4c98508c498c9b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.417019:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499200/0xaa4c98508c498c9b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.417029:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499200/0xaa4c98508c498c9b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179130.417119:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788179130.417123:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788179130.417374:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499200/0xaa4c98508c498c9b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.417386:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498c8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.417391:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498c8d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.417397:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498c8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.417401:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc901498400 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179130.417404:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498c8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.417416:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498c8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.417427:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc903312000) 00010000:00010000:3.0:1788179130.417429:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179130.417433:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498c8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.417438:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498c8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.417450:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499600/0xaa4c98508c498c94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.417455:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499600/0xaa4c98508c498c94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.417460:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499600/0xaa4c98508c498c94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.417464:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc901499600 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179130.417467:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499600/0xaa4c98508c498c94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.417471:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499600/0xaa4c98508c498c94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.417477:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9bc903312100) 00010000:00010000:3.0:1788179130.417479:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179130.417481:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499600/0xaa4c98508c498c94 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.417495:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499600/0xaa4c98508c498c94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.417531:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498c86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f9a expref: 8 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.417544:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499200/0xaa4c98508c498c9b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f9a expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179130.417550:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bc903312700) 00010000:00010000:3.0:1788179130.417552:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788179130.417554:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc901499200, rc 0) 00000100:00100000:3.0:1788179130.417694:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:10195:x1875041451009536:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 2130us (2368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179130.417702:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:1.0:1788179130.427367:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179130.427519:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451009792 00000100:00100000:0.0:1788179130.427530:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451009792 00000100:00100000:1.0:1788179130.427753:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:1.0:1788179130.427764:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:10195:x1875041451009792:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788179130.427784:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179130.427804:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c498ca2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474661fa1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179130.427922:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c498ca9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179130.427937:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c498ca9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179130.427948:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c498ca9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179130.428009:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c498cb0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179130.428017:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c498cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179130.428024:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c498cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179130.428752:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d800/0xaa4c98508c498cb7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179130.428766:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d800/0xaa4c98508c498cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179130.428785:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d800/0xaa4c98508c498cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788179130.428796:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1788179130.429352:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c498ca9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179130.429363:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c498ca9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179130.429370:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c498ca9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179130.429376:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92e12d600 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179130.429380:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c498ca9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179130.429387:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c498ca9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179130.429400:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bc903312700) 00010000:00010000:1.0:1788179130.429403:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179130.429408:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c498ca9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179130.429414:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c498ca9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179130.429426:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c498cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179130.429432:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c498cb0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179130.429444:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c498cb0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179130.429449:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92e12d000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179130.429452:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c498cb0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179130.429458:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c498cb0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179130.429464:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bc903340400) 00010000:00010000:1.0:1788179130.429466:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179130.429469:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c498cb0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179130.429474:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c498cb0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179130.431002:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c498ca2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fa1 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179130.431026:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d800/0xaa4c98508c498cb7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fa1 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179130.431035:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bc903340c00) 00010000:00010000:1.0:1788179130.431037:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179130.431040:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc92e12d800, rc 0) 00000100:00100000:1.0:1788179130.431163:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+9:10195:x1875041451009792:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 3399us (3804us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788179130.431183:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:1.0:1788179130.439195:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179130.439274:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451009920 00000100:00100000:2.0:1788179130.439291:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451009920 00000100:00100000:2.0:1788179130.439345:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:2.0:1788179130.439354:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+9:10195:x1875041451009920:12345-192.168.202.2@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788179130.439450:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+9:10195:x1875041451009920:12345-192.168.202.2@tcp:59:lhsmtool_posix.0 Request processed in 97us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179130.439472:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 35 00010000:00010000:1.0:1788179130.624281:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788179131.076621:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788179131.076645:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc906224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472018048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788179131.076713:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179131.076773:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472018048 00000100:00100000:2.0:1788179131.076780:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472018048 00000100:00100000:2.0:1788179131.076834:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788179131.076843:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472018048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788179131.076907:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179131.076965:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472018048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179131.076973:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1788179131.076994:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788179131.077033:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc906224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472018048:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788179131.465235:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788179131.656910:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179132.098444:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472018176:0@lo:400:kworker.0 00000100:00100000:0.0:1788179132.098553:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179132.098600:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041472018688:0@lo:400:kworker.0 00000100:00100000:0.0:1788179132.098627:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179132.098653:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788179132.098658:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041472018304:0@lo:400:kworker.0 00000100:00100000:0.0:1788179132.098678:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179132.098696:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472018816:0@lo:400:kworker.0 00000100:00100000:0.0:1788179132.098718:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179132.098748:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041472018432:0@lo:400:kworker.0 00000100:00100000:0.0:1788179132.098770:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179132.098789:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788179132.098794:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472018560:0@lo:400:kworker.0 00000100:00100000:0.0:1788179132.098814:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179132.098863:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472018176 00000100:00100000:0.0:1788179132.098870:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472018176 00000100:00100000:0.0:1788179132.098917:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788179132.098925:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+19:3307:x1875041472018176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179132.098984:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+19:3307:x1875041472018176:12345-0@lo:400:kworker.0 Request processed in 59us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179132.098992:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788179132.099028:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472018688 00000100:00100000:0.0:1788179132.099032:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472018688 00000100:00100000:0.0:1788179132.099067:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472018304 00000100:00100000:0.0:1788179132.099070:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472018304 00000100:00100000:0.0:1788179132.099082:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472018432 00000100:00100000:0.0:1788179132.099084:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472018432 00000100:00100000:0.0:1788179132.099098:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788179132.099111:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875041472018688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179132.099143:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875041472018688:12345-0@lo:400:kworker.0 Request processed in 33us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179132.099149:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788179132.099163:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788179132.099181:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041472018304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179132.099207:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041472018304:12345-0@lo:400:kworker.0 Request processed in 39us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179132.099213:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788179132.099225:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788179132.099230:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041472018432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179132.099259:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041472018432:12345-0@lo:400:kworker.0 Request processed in 29us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179132.099264:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788179132.099285:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472018816 00000100:00100000:0.0:1788179132.099288:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472018816 00000100:00100000:0.0:1788179132.099313:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472018560 00000100:00100000:0.0:1788179132.099317:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472018560 00000100:00100000:0.0:1788179132.099335:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788179132.099341:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472018816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179132.099369:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472018816:12345-0@lo:400:kworker.0 Request processed in 29us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179132.099375:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788179132.099386:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788179132.099391:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472018560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179132.099414:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472018560:12345-0@lo:400:kworker.0 Request processed in 23us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179132.099426:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1788179132.099450:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788179132.099454:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788179132.099492:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472018560:0@lo:400:kworker.0 00000100:00100000:0.0:1788179132.099504:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041472018432:0@lo:400:kworker.0 00000100:00100000:0.0:1788179132.099532:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041472018304:0@lo:400:kworker.0 00010000:00080000:0.0:1788179132.099544:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8d4a80 x1875041472018816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788179148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179132.099554:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472018816:0@lo:400:kworker.0 00000100:00100000:0.0:1788179132.099561:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472018176:0@lo:400:kworker.0 00000100:00100000:0.0:1788179132.099570:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041472018688:0@lo:400:kworker.0 00000100:00100000:3.0:1788179132.376193:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179132.376264:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451010048 00000100:00100000:0.0:1788179132.376274:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451010048 00000100:00100000:0.0:1788179132.376356:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:0.0:1788179132.376368:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+9:10238:x1875041451010048:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788179132.376390:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179132.376411:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030600/0xaa4c98508c498cc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474661fa8 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.376474:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030400/0xaa4c98508c498ccc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.376488:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030400/0xaa4c98508c498ccc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.376514:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030400/0xaa4c98508c498ccc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.376530:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030a00/0xaa4c98508c498cd3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.376538:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030a00/0xaa4c98508c498cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.376543:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030a00/0xaa4c98508c498cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.376782:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030400/0xaa4c98508c498ccc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.376790:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030400/0xaa4c98508c498ccc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.376795:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030400/0xaa4c98508c498ccc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.376801:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc900030400 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179132.376805:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030400/0xaa4c98508c498ccc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.376812:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030400/0xaa4c98508c498ccc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.376823:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc903312000) 00010000:00010000:0.0:1788179132.376826:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179132.376831:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030400/0xaa4c98508c498ccc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.376878:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030400/0xaa4c98508c498ccc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.376890:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030a00/0xaa4c98508c498cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.376896:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030a00/0xaa4c98508c498cd3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.376901:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030a00/0xaa4c98508c498cd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.376907:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc900030a00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179132.376910:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030a00/0xaa4c98508c498cd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.376916:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030a00/0xaa4c98508c498cd3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.376924:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9bc9062cb300) 00010000:00010000:0.0:1788179132.376927:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179132.376930:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030a00/0xaa4c98508c498cd3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.376944:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030a00/0xaa4c98508c498cd3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.376981:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030600/0xaa4c98508c498cc5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fa8 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.377003:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc903312000) 00010000:00010000:0.0:1788179132.377005:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179132.377009:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030600/0xaa4c98508c498cc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fa8 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.377018:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc900030600, rc 0) 00000100:00100000:0.0:1788179132.377078:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+9:10238:x1875041451010048:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 712us (896us total) trans 0 rc 301/301 00000100:00100000:0.0:1788179132.377085:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00080000:3.0:1788179132.377418:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788179132.381275:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179132.381351:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451010304 00000100:00100000:2.0:1788179132.381362:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451010304 00000100:00100000:2.0:1788179132.381424:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 37 00000100:00100000:2.0:1788179132.381434:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+9:10238:x1875041451010304:12345-192.168.202.2@tcp:36:lfs.0 00010000:00010000:2.0:1788179132.381488:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179132.381517:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498c7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f93 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.381535:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc903312000) 00010000:00010000:2.0:1788179132.381546:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788179132.381826:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498cda lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.381875:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498cda lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.381887:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498cda lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.381900:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4200/0xaa4c98508c498ce1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.381908:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4200/0xaa4c98508c498ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.381914:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4200/0xaa4c98508c498ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179132.382930:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1788179132.382959:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498cda lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.382968:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498cda lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.382974:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498cda lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.382980:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179132.382985:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498cda lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.382991:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498cda lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.383011:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc909481100) 00010000:00010000:2.0:1788179132.383014:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179132.383019:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498cda lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.383025:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498cda lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788179132.383052:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c7b098d5 reply state 00000000ed82d7cb transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4200/0xaa4c98508c498ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179132.383062:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788179132.383167:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+10:10238:x1875041451010304:12345-192.168.202.2@tcp:36:lfs.0 Request processed in 1732us (1898us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788179132.383174:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 37 00010000:00010000:2.0:1788179132.385376:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4200/0xaa4c98508c498ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.385392:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4200/0xaa4c98508c498ce1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.385399:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4200/0xaa4c98508c498ce1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.385406:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c4200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179132.385410:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4200/0xaa4c98508c498ce1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.385417:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4200/0xaa4c98508c498ce1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.385448:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9bc909481900) 00010000:00010000:2.0:1788179132.385451:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179132.385456:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4200/0xaa4c98508c498ce1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.385462:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4200/0xaa4c98508c498ce1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179132.477393:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179132.477770:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451010432 00000100:00100000:0.0:1788179132.477782:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451010432 00000100:00100000:0.0:1788179132.479019:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:0.0:1788179132.479039:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+9:10246:x1875041451010432:12345-192.168.202.2@tcp:101:lctl.0 00010000:00010000:0.0:1788179132.479066:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179132.479088:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030600/0xaa4c98508c498ce8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474661faf expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.479153:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030a00/0xaa4c98508c498cef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.479167:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030a00/0xaa4c98508c498cef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.479179:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030a00/0xaa4c98508c498cef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179132.479238:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788179132.479256:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788179132.479296:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030a00/0xaa4c98508c498cef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.479320:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030600/0xaa4c98508c498ce8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661faf expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.479338:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030a00/0xaa4c98508c498cef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661faf expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.479346:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc9062cb300) 00010000:00010000:0.0:1788179132.479348:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788179132.479351:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc900030a00, rc 0) 00000100:00100000:0.0:1788179132.479486:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+10:10246:x1875041451010432:12345-192.168.202.2@tcp:101:lctl.0 Request processed in 454us (2105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179132.479494:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:3.0:1788179132.531671:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179132.531762:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451010560 00000100:00100000:2.0:1788179132.531771:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451010560 00000100:00100000:2.0:1788179132.531827:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:2.0:1788179132.531837:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+10:10252:x1875041451010560:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1788179132.531907:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179132.531928:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498cf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474661fb6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.531997:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498cfd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.532011:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498cfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.532024:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498cfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.532038:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c498d04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.532046:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c498d04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.532063:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c498d04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.532163:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4200/0xaa4c98508c498d0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.532168:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4200/0xaa4c98508c498d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.532173:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4200/0xaa4c98508c498d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179132.532194:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1788179132.532196:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788179132.532221:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4200/0xaa4c98508c498d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.532230:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498cfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.532234:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498cfd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.532238:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498cfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.532242:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5600 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179132.532244:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498cfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.532248:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498cfd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.532262:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc9062cb300) 00010000:00010000:2.0:1788179132.532264:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179132.532267:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498cfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.532283:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498cfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.532293:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c498d04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.532297:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c498d04 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.532300:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c498d04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.532303:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5800 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179132.532305:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c498d04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.532308:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c498d04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.532312:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9bc909481900) 00010000:00010000:2.0:1788179132.532313:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179132.532314:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c498d04 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.532317:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c498d04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.532355:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498cf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fb6 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.532364:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4200/0xaa4c98508c498d0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fb6 expref: 11 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.532369:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:2.0:1788179132.532370:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788179132.532371:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c4200, rc 0) 00000100:00100000:2.0:1788179132.532423:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+11:10252:x1875041451010560:12345-192.168.202.2@tcp:101:bash.0 Request processed in 587us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179132.532430:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:2.0:1788179132.536908:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179132.537005:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451010816 00000100:00100000:0.0:1788179132.537015:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451010816 00000100:00100000:0.0:1788179132.537109:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00100000:0.0:1788179132.537120:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+11:10252:x1875041451010816:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1788179132.537141:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179132.537161:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030400/0xaa4c98508c498d12 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474661fbd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.537308:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030600/0xaa4c98508c498d19 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.537325:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030600/0xaa4c98508c498d19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.537360:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030600/0xaa4c98508c498d19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.537422:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030800/0xaa4c98508c498d20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.537430:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030800/0xaa4c98508c498d20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.537437:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030800/0xaa4c98508c498d20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788179132.538293:0:5827:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1788179132.538488:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030000/0xaa4c98508c498d27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.538499:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030000/0xaa4c98508c498d27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.538507:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030000/0xaa4c98508c498d27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.538541:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030600/0xaa4c98508c498d19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.538547:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030600/0xaa4c98508c498d19 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.538552:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030600/0xaa4c98508c498d19 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.538557:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc900030600 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179132.538568:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030600/0xaa4c98508c498d19 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.538575:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030600/0xaa4c98508c498d19 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.538587:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:0.0:1788179132.538590:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179132.538595:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030600/0xaa4c98508c498d19 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.538601:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030600/0xaa4c98508c498d19 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788179132.538612:0:5827:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000563a3633 reply state 000000008df846c4 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030800/0xaa4c98508c498d20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179132.538621:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788179132.538652:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030400/0xaa4c98508c498d12 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fbd expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.538664:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030000/0xaa4c98508c498d27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fbd expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.538670:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cbf00) 00010000:00010000:0.0:1788179132.538673:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788179132.538674:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc900030000, rc 0) 00000100:00100000:0.0:1788179132.538749:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+14:10252:x1875041451010816:12345-192.168.202.2@tcp:101:bash.0 Request processed in 1631us (1851us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788179132.538756:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00100000:2.0:1788179132.542492:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179132.542553:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451010944 00000100:00100000:0.0:1788179132.542564:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451010944 00000100:00100000:0.0:1788179132.542617:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:0.0:1788179132.542626:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906225180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1875041451010944:12345-192.168.202.2@tcp:8:bash.0 00010000:00080000:0.0:1788179132.542658:0:6589:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 334bb25c-6762-4beb-8a84-3a838cbc7e80@192.168.202.2@tcp t0 exp 0000000000000000 cur 328 last 0 00000020:00000080:0.0:1788179132.542688:0:6589:0:(genops.c:1407:class_connect()) connect: client 334bb25c-6762-4beb-8a84-3a838cbc7e80, cookie 0xaa4c98508c498d35 00002000:00100000:0.0:1788179132.542699:0:6589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 334bb25c-6762-4beb-8a84-3a838cbc7e80/ffff9bc93ab5b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211371b ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788179132.542720:0:6589:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788179132.542986:0:6589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788179132.543014:0:6589:0:(import.c:65:import_set_state_nolock()) ffff9bc93ab5e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788179132.543078:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906225180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2353:x1875041451010944:12345-192.168.202.2@tcp:8:bash.0 Request processed in 451us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179132.543085:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00010000:00010000:3.0:1788179132.545468:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030800/0xaa4c98508c498d20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.545484:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030800/0xaa4c98508c498d20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.545491:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030800/0xaa4c98508c498d20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.545497:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc900030800 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179132.545515:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030800/0xaa4c98508c498d20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.545523:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030800/0xaa4c98508c498d20 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.545542:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bc9062cb000) 00010000:00010000:3.0:1788179132.545545:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179132.545550:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030800/0xaa4c98508c498d20 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.545555:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030800/0xaa4c98508c498d20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179132.545656:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179132.545738:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451011072 00000100:00100000:0.0:1788179132.545747:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451011072 00000100:00100000:0.0:1788179132.545866:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:0.0:1788179132.545877:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:0:x1875041451011072:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1788179132.545892:0:7778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179132.545910:0:7778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001147547e/0xaa4c98508c498d3c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474661fc4 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788179132.545943:0:7778:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788179132.545961:0:7778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=328s v=(0 0) 00010000:00010000:0.0:1788179132.545965:0:7778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788179132.545974:0:7778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001147547e/0xaa4c98508c498d3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fc4 expref: 7 pid: 7778 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.546005:0:7778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001147547e/0xaa4c98508c498d3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fc4 expref: 7 pid: 7778 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.546017:0:7778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317f000, rc 0) 00000100:00100000:0.0:1788179132.546114:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:0:x1875041451011072:12345-192.168.202.2@tcp:101:bash.0 Request processed in 239us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179132.546121:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00080000:3.0:1788179132.546331:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788179132.548757:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179132.549066:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451011200 00000100:00100000:0.0:1788179132.549077:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451011200 00000100:00100000:0.0:1788179132.549173:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:0.0:1788179132.549183:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:10252:x1875041451011200:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1788179132.549200:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179132.549219:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd68afeb/0xaa4c98508c498d43 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474661fcb expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.549254:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001147547e/0xaa4c98508c498d3c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fc4 expref: 8 pid: 7778 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.549265:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788179132.549280:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788179132.549285:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd68afeb/0xaa4c98508c498d43 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fcb expref: 8 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.549323:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001147547e/0xaa4c98508c498d3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fc4 expref: 8 pid: 7778 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.549357:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001147547e/0xaa4c98508c498d3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fc4 expref: 8 pid: 7778 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179132.549371:0:6589:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bf9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6589:1875041472018944:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788179132.549494:0:6589:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc920145f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788179132.552273:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179132.552339:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451011328 00000100:00100000:3.0:1788179132.552348:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451011328 00010000:00010000:3.0:1788179132.552387:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001147547e/0xaa4c98508c498d3c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fc4 expref: 9 pid: 7778 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179132.552431:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:3.0:1788179132.552442:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906227480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+9:2356:x1875041451011328:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788179132.552457:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179132.552481:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001147547e/0xaa4c98508c498d3c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fc4 expref: 9 pid: 7778 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.552494:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001147547e/0xaa4c98508c498d3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fc4 expref: 9 pid: 7778 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.552538:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788179132.552543:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788179132.552551:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd68afeb/0xaa4c98508c498d43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fcb expref: 9 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.552561:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd68afeb/0xaa4c98508c498d43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fcb expref: 9 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.552596:0:5783:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dd68afeb/0xaa4c98508c498d43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fcb expref: 9 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179132.552611:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b613480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5783:1875041472019072:192.168.202.2@tcp:105: 00000100:00100000:3.0:1788179132.552691:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9359ea480 going to sleep for 11 seconds 00010000:00010000:0.0:1788179132.553254:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001147547e/0xaa4c98508c498d3c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fc4 expref: 9 pid: 7778 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179132.553273:0:6589:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bf9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6589:1875041472018944:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788179132.553295:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd68afeb/0xaa4c98508c498d43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fcb expref: 8 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.553307:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317fc00, rc 0) 00000100:00100000:0.0:1788179132.553354:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:10252:x1875041451011200:12345-192.168.202.2@tcp:101:bash.0 Request processed in 4171us (4604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179132.553362:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:2.0:1788179132.560763:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179132.560840:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451011584 00000100:00100000:1.0:1788179132.560883:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451011584 00000100:00100000:1.0:1788179132.560948:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:1.0:1788179132.560958:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+13:10252:x1875041451011584:12345-192.168.202.2@tcp:35:bash.0 00000100:00100000:1.0:1788179132.561315:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+14:10252:x1875041451011584:12345-192.168.202.2@tcp:35:bash.0 Request processed in 357us (561us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788179132.561323:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:3.0:1788179132.561790:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b613480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5783:1875041472019072:192.168.202.2@tcp:105: 00010000:00010000:3.0:1788179132.561811:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179132.561886:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906227480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2356:x1875041451011328:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 9445us (9631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179132.561895:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:0.0:1788179132.608360:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc906227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472019200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788179132.608452:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179132.608645:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472019200 00000100:00100000:2.0:1788179132.608653:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472019200 00000100:00100000:2.0:1788179132.608704:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788179132.608713:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472019200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788179132.608734:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179132.608784:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472019200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179132.608791:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788179132.609145:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc906227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472019200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788179132.643979:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179132.644102:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451011840 00000100:00100000:0.0:1788179132.644112:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451011840 00000100:00100000:0.0:1788179132.644177:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 41 00000100:00100000:0.0:1788179132.644188:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+14:10262:x1875041451011840:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788179132.644219:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179132.644241:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498d4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474661fd2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179132.644367:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1788179132.644500:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498d4a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fd2 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.644514:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc9062cb300) 00010000:00010000:0.0:1788179132.644517:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788179132.644521:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498d4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fd2 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.644536:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317f400, rc 0) 00000100:00100000:0.0:1788179132.644599:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+15:10262:x1875041451011840:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 412us (631us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1788179132.644606:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 41 00000100:00100000:1.0:1788179132.647223:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179132.647319:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451012096 00000100:00100000:2.0:1788179132.647329:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451012096 00000100:00100000:2.0:1788179132.647384:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:2.0:1788179132.647394:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+15:10262:x1875041451012096:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:2.0:1788179132.647732:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+16:10262:x1875041451012096:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 338us (517us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788179132.647740:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00010000:00010000:1.0:1788179132.674110:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788179132.710705:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179132.710884:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451012224 00000100:00100000:3.0:1788179132.710894:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451012224 00000100:00100000:3.0:1788179132.710962:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:3.0:1788179132.710995:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+16:10268:x1875041451012224:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1788179132.711022:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179132.711045:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498d58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474661fd9 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.711133:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499600/0xaa4c98508c498d5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.711145:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499600/0xaa4c98508c498d5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.711157:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499600/0xaa4c98508c498d5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179132.711213:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1788179132.711217:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788179132.711242:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499600/0xaa4c98508c498d5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.711414:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498d58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fd9 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.711443:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499600/0xaa4c98508c498d5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fd9 expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.711453:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:3.0:1788179132.711456:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788179132.711460:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc901499600, rc 0) 00000100:00100000:3.0:1788179132.711520:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+17:10268:x1875041451012224:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 548us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179132.711527:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:0.0:1788179132.716544:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179132.716640:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451012480 00000100:00100000:2.0:1788179132.716650:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451012480 00000100:00100000:2.0:1788179132.716706:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:2.0:1788179132.716716:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+17:10268:x1875041451012480:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788179132.716737:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179132.716758:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c498d66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474661fe0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.716892:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c498d6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.716905:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c498d6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.716915:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c498d6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179132.716925:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788179132.717061:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c498d66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fe0 expref: 20 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.717095:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c498d6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fe0 expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.717104:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cbf00) 00010000:00010000:2.0:1788179132.717107:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788179132.717110:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c4000, rc 0) 00000100:00100000:2.0:1788179132.717158:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+19:10268:x1875041451012480:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 443us (624us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788179132.717165:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:1.0:1788179132.720598:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179132.720690:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179132.720766:0:11517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451012864 00000100:00100000:2.0:1788179132.720778:0:11517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451012864 00000100:00100000:2.0:1788179132.720876:0:11517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:2.0:1788179132.720888:0:11517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+19:2357:x1875041451012864:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788179132.720902:0:11517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179132.720924:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c498d6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fe0 expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.720953:0:11517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cbf00) 00010000:00010000:2.0:1788179132.720957:0:11517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788179132.721014:0:11517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+18:2357:x1875041451012864:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 129us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179132.721023:0:11517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:0.0:1788179132.722168:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451012736 00000100:00100000:0.0:1788179132.722179:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451012736 00000100:00100000:0.0:1788179132.722254:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:0.0:1788179132.722272:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+18:10268:x1875041451012736:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788179132.722292:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179132.722310:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498d7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474661fe7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.722402:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498d82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.722444:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498d82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.722455:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498d82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179132.722469:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788179132.722585:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498d7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fe7 expref: 21 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.722602:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498d82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fe7 expref: 20 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.722610:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cbf00) 00010000:00010000:0.0:1788179132.722613:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788179132.722616:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317e200, rc 0) 00000100:00100000:0.0:1788179132.722669:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+20:10268:x1875041451012736:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 406us (2079us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788179132.722675:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:1.0:1788179132.728026:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179132.728149:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451012992 00000100:00100000:3.0:1788179132.728160:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451012992 00000100:00100000:3.0:1788179132.728229:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:3.0:1788179132.728239:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2357:x1875041451012992:12345-192.168.202.2@tcp:1:lfs.0 00010000:00010000:3.0:1788179132.728378:0:7778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000135f2d6a/0xaa4c98508c498d90 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.728399:0:7778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd68afeb/0xaa4c98508c498d43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fcb expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.728408:0:7778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788179132.728412:0:7778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788179132.728416:0:7778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000135f2d6a/0xaa4c98508c498d90 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.728450:0:7778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd68afeb/0xaa4c98508c498d43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fcb expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.728464:0:7778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd68afeb/0xaa4c98508c498d43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fcb expref: 7 pid: 6589 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179132.728477:0:7778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b613480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7778:1875041472019328:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788179132.728563:0:7778:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9359ea480 going to sleep for 11 seconds 00000100:00100000:3.0:1788179132.730798:0:7778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b613480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7778:1875041472019328:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788179132.730825:0:7778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000135f2d6a/0xaa4c98508c498d90 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179132.732818:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179132.733100:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451013120 00000100:00100000:3.0:1788179132.733117:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451013120 00002000:00100000:3.0:1788179132.733158:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9bc92e0f5500 x1875041451013120/t0(0) o4->334bb25c-6762-4beb-8a84-3a838cbc7e80@192.168.202.2@tcp:148/0 lens 504/0 e 0 to 0 dl 1788179143 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788179132.733170:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bc92e0f5500 with x1875041451013120 ext(0->12) 00010000:00010000:3.0:1788179132.733179:0:6595:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dd68afeb/0xaa4c98508c498d43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fcb expref: 8 pid: 6589 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.733194:0:6595:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dd68afeb/0xaa4c98508c498d43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fcb expref: 8 pid: 6589 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788179132.733202:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bc92e0f5500 00000100:00100000:3.0:1788179132.733272:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:3.0:1788179132.733282:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2356:x1875041451013120:12345-192.168.202.2@tcp:4:lfs.0 00000001:00100000:0.0:1788179132.761520:0:7496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 334bb25c-6762-4beb-8a84-3a838cbc7e80 00000001:00080000:2.0:1788179132.794754:0:7496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1788179132.794978:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2356:x1875041451013120:12345-192.168.202.2@tcp:4:lfs.0 Request processed in 61692us (62164us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788179132.794992:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00002000:00100000:3.0:1788179132.795005:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9bc92e0f5500 x1875041451013120/t4294967299(0) o4->334bb25c-6762-4beb-8a84-3a838cbc7e80@192.168.202.2@tcp:148/0 lens 504/448 e 0 to 0 dl 1788179143 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788179132.795014:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bc92e0f5500 with x1875041451013120 ext(0->12) 00010000:00010000:3.0:1788179132.795024:0:6595:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dd68afeb/0xaa4c98508c498d43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fcb expref: 7 pid: 6589 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.795041:0:6595:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dd68afeb/0xaa4c98508c498d43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fcb expref: 7 pid: 6589 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788179132.795048:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bc92e0f5500 00000100:00100000:2.0:1788179132.797676:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179132.797762:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451013248 00000100:00100000:1.0:1788179132.797771:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451013248 00010000:00010000:1.0:1788179132.797808:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd68afeb/0xaa4c98508c498d43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fcb expref: 7 pid: 6589 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179132.797944:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:1.0:1788179132.797954:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906225500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2356:x1875041451013248:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788179132.797980:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788179132.797998:0:5782:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788179132.798001:0:5782:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788179131 00002000:00010000:1.0:1788179132.798003:0:5782:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788179132 00002000:00010000:1.0:1788179132.798006:0:5782:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788179131 00002000:00010000:1.0:1788179132.798008:0:5782:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1788179132.798014:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd68afeb/0xaa4c98508c498d43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fcb expref: 7 pid: 6589 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179132.798026:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd68afeb/0xaa4c98508c498d43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fcb expref: 7 pid: 6589 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179132.798049:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd68afeb/0xaa4c98508c498d43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fcb expref: 7 pid: 6589 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179132.798067:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788179132.798071:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788179132.798077:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000135f2d6a/0xaa4c98508c498d90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179132.798088:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000135f2d6a/0xaa4c98508c498d90 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179132.798119:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788179132.798166:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906225500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2356:x1875041451013248:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 214us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179132.798174:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 36 00010000:00010000:0.0:1788179132.798803:0:7778:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000135f2d6a/0xaa4c98508c498d90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.798817:0:7778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000135f2d6a/0xaa4c98508c498d90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.798867:0:7778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000135f2d6a/0xaa4c98508c498d90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.798883:0:7778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000135f2d6a/0xaa4c98508c498d90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.798890:0:7778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000135f2d6a/0xaa4c98508c498d90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.798898:0:7778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc901498400 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179132.798902:0:7778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000135f2d6a/0xaa4c98508c498d90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.798910:0:7778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000135f2d6a/0xaa4c98508c498d90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.798922:0:7778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000135f2d6a/0xaa4c98508c498d90 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.798939:0:7778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000135f2d6a/0xaa4c98508c498d90 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179132.799044:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2357:x1875041451012992:12345-192.168.202.2@tcp:1:lfs.0 Request processed in 70805us (71025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179132.799052:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:2.0:1788179132.802112:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179132.802360:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451013504 00000100:00100000:1.0:1788179132.802371:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451013504 00000100:00100000:1.0:1788179132.802437:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:1.0:1788179132.802448:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+20:10268:x1875041451013504:12345-192.168.202.2@tcp:35:lfs.0 00000004:00010000:1.0:1788179132.802510:0:5800:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498d82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fe7 expref: 20 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788179132.802789:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1788179132.803039:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1788179132.804072:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1788179132.804141:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498d97 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.804159:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030000/0xaa4c98508c498d27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fbd expref: 24 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.804168:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498d97 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.804207:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030000/0xaa4c98508c498d27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fbd expref: 24 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.804224:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030000/0xaa4c98508c498d27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fbd expref: 24 pid: 5827 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179132.804239:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc906224700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5800:1875041472019456:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788179132.804396:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc926633240 going to sleep for 11 seconds 00000100:00100000:0.0:1788179132.807097:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc906224700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5800:1875041472019456:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788179132.807126:0:5800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498d97 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179132.807496:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179132.807566:0:11517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451013632 00000100:00100000:0.0:1788179132.807573:0:11517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451013632 00010000:00010000:0.0:1788179132.807605:0:11517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030000/0xaa4c98508c498d27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fbd expref: 25 pid: 5827 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179132.807643:0:11517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 37 00000100:00100000:0.0:1788179132.807653:0:11517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906224000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+25:2356:x1875041451013632:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179132.807668:0:11517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179132.807675:0:11517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030000/0xaa4c98508c498d27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fbd expref: 25 pid: 5827 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.807687:0:11517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030000/0xaa4c98508c498d27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fbd expref: 25 pid: 5827 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.807707:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030000/0xaa4c98508c498d27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fbd expref: 25 pid: 5827 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.807720:0:11517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cbf00) 00010000:00010000:0.0:1788179132.807725:0:11517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498d97 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.807733:0:11517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498d97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.807740:0:11517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498d97 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.807767:0:11517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179132.807827:0:11517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906224000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+24:2356:x1875041451013632:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 175us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179132.807842:0:11517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 37 00010000:00010000:2.0:1788179132.808436:0:5800:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498d97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179132.808446:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498d97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788179132.808564:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788179132.808756:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1788179132.809113:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc906226a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5800:1875041472019584:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788179132.809166:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179132.809238:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc926633240 going to sleep for 11 seconds 00000100:00100000:1.0:1788179132.809656:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472019584 00000100:00100000:1.0:1788179132.809664:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472019584 00000100:00100000:1.0:1788179132.809791:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788179132.809801:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5800:x1875041472019584:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788179132.809915:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5800:x1875041472019584:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 115us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179132.809923:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788179132.810009:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc906226a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5800:1875041472019584:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788179132.810638:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1788179132.810703:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bf9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5800:1875041472019712:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788179132.810740:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179132.811120:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9054b4300 going to sleep for 11 seconds 00000100:00100000:2.0:1788179132.811193:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472019712 00000100:00100000:2.0:1788179132.811199:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472019712 00000100:00100000:2.0:1788179132.811231:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788179132.811240:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5800:x1875041472019712:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788179132.811562:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5800:x1875041472019712:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 322us (820us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788179132.811570:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788179132.811655:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bf9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5800:1875041472019712:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788179132.811721:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1788179132.811764:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498d97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.811774:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498d97 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.811780:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498d97 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.811785:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5e00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179132.811789:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498d97 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.811796:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498d97 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.811810:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cbf00) 00010000:00010000:0.0:1788179132.811813:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788179132.811817:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498d97 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.811829:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498d97 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788179132.815073:0:5800:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788179132.815365:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1788179132.815377:0:5800:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 328878526947ns, next at 329878525027ns, rc = 0 00000001:00080000:0.0:1788179132.815386:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1788179132.815442:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cbf00) 00010000:00010000:0.0:1788179132.815447:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788179132.815457:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498d82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fe7 expref: 28 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179132.815628:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+27:10268:x1875041451013504:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 13180us (13523us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788179132.815638:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00000020:00080000:0.0:1788179132.815643:0:5800:0:(tgt_main.c:811:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788179132.817442:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179132.817519:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451013760 00000100:00100000:0.0:1788179132.817527:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451013760 00000100:00100000:0.0:1788179132.817607:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00100000:0.0:1788179132.817616:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+27:10268:x1875041451013760:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788179132.817637:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179132.817658:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c498d9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474661fee expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.817709:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c498d9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fee expref: 28 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.817739:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c498d9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fee expref: 28 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.817757:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:0.0:1788179132.817760:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788179132.817764:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317fa00, rc 0) 00000100:00100000:0.0:1788179132.817811:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+28:10268:x1875041451013760:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 196us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179132.817818:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00100000:2.0:1788179132.820770:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179132.821001:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451014016 00000100:00100000:3.0:1788179132.821011:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451014016 00000100:00100000:2.0:1788179132.821135:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:2.0:1788179132.821145:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9266fd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+28:10268:x1875041451014016:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:2.0:1788179132.821443:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9266fd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+29:10268:x1875041451014016:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 298us (679us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788179132.821451:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:1.0:1788179132.889497:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179132.889573:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451014272 00000100:00100000:3.0:1788179132.889581:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451014272 00000100:00100000:3.0:1788179132.889635:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:3.0:1788179132.889643:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+29:10278:x1875041451014272:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1788179132.889667:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179132.889686:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498da5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474661ff5 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179132.889796:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1788179132.889948:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498da5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ff5 expref: 31 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.889959:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc9062cb300) 00010000:00010000:3.0:1788179132.889961:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788179132.889964:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498da5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ff5 expref: 31 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.889976:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc901498000, rc 0) 00000100:00100000:3.0:1788179132.890061:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+30:10278:x1875041451014272:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 419us (578us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1788179132.890066:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:3.0:1788179132.892993:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179132.893091:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451014400 00000100:00100000:0.0:1788179132.893099:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451014400 00000100:00100000:0.0:1788179132.893191:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:0.0:1788179132.893201:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+30:10278:x1875041451014400:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:0.0:1788179132.893282:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498db3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893299:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498db3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893311:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498db3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893328:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498dba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893336:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893361:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893471:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498dc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893480:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893487:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788179132.893524:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893536:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498db3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893542:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498db3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893549:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498db3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893554:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317e200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179132.893559:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498db3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893566:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498db3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893575:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:0.0:1788179132.893583:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179132.893588:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498db3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893594:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498db3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893606:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893612:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498dba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893618:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498dba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893622:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317fc00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179132.893625:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498dba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893630:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498dba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893636:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bc9062cbf00) 00010000:00010000:0.0:1788179132.893638:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179132.893641:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498dba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893646:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498dba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893660:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893670:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498dc1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893675:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498dc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893680:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317e400 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179132.893683:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498dc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893689:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498dc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893696:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:0.0:1788179132.893698:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179132.893701:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498dc1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.893707:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498dc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179132.893774:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+30:10278:x1875041451014400:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 574us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179132.893781:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:2.0:1788179132.896750:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179132.896827:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451014656 00000100:00100000:0.0:1788179132.896837:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451014656 00000100:00100000:0.0:1788179132.896917:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:0.0:1788179132.896940:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+30:10278:x1875041451014656:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:0.0:1788179132.897185:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+31:10278:x1875041451014656:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 259us (443us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788179132.897205:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:1.0:1788179132.931758:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179132.932004:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451014912 00000100:00100000:3.0:1788179132.932014:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451014912 00000100:00100000:3.0:1788179132.932110:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:3.0:1788179132.932122:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+31:10281:x1875041451014912:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1788179132.932162:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179132.932184:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498dc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474661ffc expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.932278:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498dcf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.932293:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498dcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.932303:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498dcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.932316:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498dd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.932321:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.932327:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.932469:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c498ddd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.932478:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c498ddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.932485:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c498ddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179132.932493:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788179132.932656:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498dcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.932663:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498dcf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.932670:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498dcf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.932676:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc901498400 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179132.932680:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498dcf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.932688:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498dcf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.932699:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:3.0:1788179132.932702:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179132.932706:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498dcf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.932713:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498400/0xaa4c98508c498dcf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.932727:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.932733:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498dd6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.932739:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498dd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.932752:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc901499e00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179132.932756:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498dd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.932761:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498dd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.932769:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bc903312600) 00010000:00010000:3.0:1788179132.932772:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179132.932775:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498dd6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.932780:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499e00/0xaa4c98508c498dd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.932818:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901498000/0xaa4c98508c498dc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ffc expref: 34 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.932832:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c498ddd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ffc expref: 33 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179132.932898:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:3.0:1788179132.932900:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788179132.932902:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b5200, rc 0) 00000100:00100000:3.0:1788179132.932975:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+33:10281:x1875041451014912:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 856us (1227us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1788179132.932983:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:2.0:1788179132.938376:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179132.939659:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451015040 00000100:00100000:0.0:1788179132.939672:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451015040 00000100:00100000:0.0:1788179132.939766:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:0.0:1788179132.939777:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+33:10281:x1875041451015040:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:0.0:1788179132.939939:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498deb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.939956:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498deb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.939969:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498deb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.939994:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498deb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.940001:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498deb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.940008:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498deb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.940013:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317e400 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179132.940018:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498deb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.940025:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498deb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.940035:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:0.0:1788179132.940050:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788179132.940055:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498deb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179132.940062:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498deb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179132.940773:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+33:10281:x1875041451015040:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 993us (2403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179132.940783:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:2.0:1788179132.943387:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179132.943597:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451015296 00000100:00100000:0.0:1788179132.943607:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451015296 00000100:00100000:0.0:1788179132.943703:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:0.0:1788179132.943714:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+33:10281:x1875041451015296:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:0.0:1788179132.943985:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+34:10281:x1875041451015296:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 272us (606us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788179132.943993:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:1.0:1788179133.206817:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179133.207005:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451015552 00000100:00100000:0.0:1788179133.207015:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451015552 00000100:00100000:0.0:1788179133.207077:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 50 00000100:00100000:0.0:1788179133.207089:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+34:10312:x1875041451015552:12345-192.168.202.2@tcp:101:cat.0 00010000:00010000:0.0:1788179133.207118:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179133.207144:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498df2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662003 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.207255:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498df9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.207270:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.207297:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179133.207310:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788179133.208764:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498df2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662003 expref: 37 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.208793:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498df9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662003 expref: 36 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.208802:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:0.0:1788179133.208804:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788179133.208808:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317fc00, rc 0) 00000100:00100000:0.0:1788179133.209018:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+36:10312:x1875041451015552:12345-192.168.202.2@tcp:101:cat.0 Request processed in 1931us (2209us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788179133.209027:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 50 00000100:00100000:2.0:1788179133.215354:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179133.215410:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179133.215519:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451015936 00000100:00100000:3.0:1788179133.215557:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451015936 00000100:00100000:3.0:1788179133.215629:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:3.0:1788179133.215639:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90710c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+36:2356:x1875041451015936:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788179133.215654:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179133.215682:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498df9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662003 expref: 36 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.215701:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:3.0:1788179133.215706:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179133.215768:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90710c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+35:2356:x1875041451015936:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 130us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179133.215775:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:1.0:1788179133.218712:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451015808 00000100:00100000:1.0:1788179133.218726:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451015808 00000100:00100000:1.0:1788179133.218804:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:1.0:1788179133.218814:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+35:10312:x1875041451015808:12345-192.168.202.2@tcp:35:cat.0 00000100:00100000:1.0:1788179133.219227:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+36:10312:x1875041451015808:12345-192.168.202.2@tcp:35:cat.0 Request processed in 412us (3881us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1788179133.219236:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:2.0:1788179133.288130:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179133.288213:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451016192 00000100:00100000:3.0:1788179133.288224:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451016192 00000100:00100000:3.0:1788179133.288297:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:3.0:1788179133.288308:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+36:10318:x1875041451016192:12345-192.168.202.2@tcp:101:dd.0 00010000:00010000:3.0:1788179133.288335:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179133.288339:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788179133.288364:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499600/0xaa4c98508c498d5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fd9 expref: 36 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.288383:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:3.0:1788179133.288388:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788179133.288401:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c498e07 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466200a expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.288503:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c498e0e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.288671:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c498ddd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ffc expref: 36 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.288680:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c498e0e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.288712:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c498ddd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ffc expref: 36 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.288725:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c498ddd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ffc expref: 36 pid: 5797 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179133.288738:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b611f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1875041472019840:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788179133.288830:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9265d0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788179133.292963:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179133.293055:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b611f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1875041472019840:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788179133.293087:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c498e0e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179133.293235:0:11517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451016320 00000100:00100000:0.0:1788179133.293243:0:11517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451016320 00010000:00010000:0.0:1788179133.293290:0:11517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c498ddd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ffc expref: 37 pid: 5797 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179133.293320:0:11517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:0.0:1788179133.293329:0:11517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906225500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+37:2356:x1875041451016320:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179133.293343:0:11517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179133.293351:0:11517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c498ddd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ffc expref: 37 pid: 5797 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.293380:0:11517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c498ddd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ffc expref: 37 pid: 5797 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.293403:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c498ddd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ffc expref: 37 pid: 5797 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.293419:0:11517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:0.0:1788179133.293424:0:11517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c498e0e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.293434:0:11517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c498e0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.293442:0:11517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c498e0e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.293474:0:11517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179133.293536:0:11517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906225500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+36:2356:x1875041451016320:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 208us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179133.293543:0:11517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 38 00010000:00010000:2.0:1788179133.293944:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c498e0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179133.293952:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c498e0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179133.293968:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788179133.294130:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c498e07 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466200a expref: 37 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179133.294146:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c498e0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466200a expref: 36 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179133.294153:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:2.0:1788179133.294156:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788179133.294159:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4800, rc 0) 00000100:00100000:2.0:1788179133.294190:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+36:10318:x1875041451016192:12345-192.168.202.2@tcp:101:dd.0 Request processed in 5883us (6069us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788179133.294197:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:0.0:1788179133.298365:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179133.298564:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451016576 00000100:00100000:3.0:1788179133.298574:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451016576 00000100:00100000:3.0:1788179133.298650:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 52 00000100:00100000:3.0:1788179133.298660:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+36:10318:x1875041451016576:12345-192.168.202.2@tcp:36:dd.0 00010000:00010000:3.0:1788179133.298958:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498e1c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.298974:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498e1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.298999:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498e1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788179133.299056:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1788179133.299079:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002c4f501b reply state 0000000069762a87 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498e1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179133.299088:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788179133.299169:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+39:10318:x1875041451016576:12345-192.168.202.2@tcp:36:dd.0 Request processed in 511us (815us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788179133.299175:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 52 00000020:00080000:3.0:1788179133.299179:0:5797:0:(tgt_main.c:811:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788179133.315103:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498e1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.315120:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498e1c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.315128:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498e1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.315133:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5a00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179133.315138:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498e1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.315145:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498e1c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.315160:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:3.0:1788179133.315163:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179133.315184:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498e1c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.315190:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498e1c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179133.582269:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179133.582316:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179133.582436:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451016704 00000100:00100000:1.0:1788179133.582458:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451016704 00000100:00100000:1.0:1788179133.582520:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 287 00000100:00100000:1.0:1788179133.582530:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2354:x1875041451016704:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179133.582604:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2354:x1875041451016704:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 75us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179133.582611:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 287 00000100:00100000:0.0:1788179133.583065:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179133.584139:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451016832 00000100:00100000:1.0:1788179133.584148:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451016832 00000100:00100000:1.0:1788179133.584202:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 74 00000100:00100000:1.0:1788179133.584211:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2354:x1875041451016832:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179133.584295:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2354:x1875041451016832:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 84us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179133.584303:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 74 00000100:00100000:2.0:1788179133.584997:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451016960 00000100:00100000:2.0:1788179133.585004:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451016960 00000100:00100000:2.0:1788179133.585116:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 132 00000100:00100000:2.0:1788179133.585125:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2354:x1875041451016960:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788179133.585229:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2354:x1875041451016960:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 105us (2911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179133.585237:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 132 00000100:00080000:3.0:1788179133.585677:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788179133.624825:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179133.625008:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451017088 00000100:00100000:2.0:1788179133.625019:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451017088 00000100:00100000:2.0:1788179133.625079:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 53 00000100:00100000:2.0:1788179133.625089:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+38:10332:x1875041451017088:12345-192.168.202.2@tcp:101:stat.0 00010000:00010000:2.0:1788179133.625115:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179133.625135:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c498e23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662011 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179133.625235:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498e2a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179133.625249:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498e2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179133.625259:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498e2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179133.625272:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c498e31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179133.625279:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c498e31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179133.625285:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c498e31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179133.625369:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498e38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179133.625378:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c498e0e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466200a expref: 39 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179133.625385:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498e38 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179133.625527:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c498e0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466200a expref: 39 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179133.625553:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c498e0e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466200a expref: 39 pid: 5796 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179133.625567:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc906224000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5827:1875041472019968:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788179133.625694:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc910ebec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788179133.633771:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179133.633880:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451017344 00000100:00100000:3.0:1788179133.633889:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451017344 00000100:00100000:3.0:1788179133.633956:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:3.0:1788179133.633966:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+40:5569:x1875041451017344:12345-192.168.202.2@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788179133.634481:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+41:5569:x1875041451017344:12345-192.168.202.2@tcp:35:ldlm_bl.0 Request processed in 515us (718us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1788179133.634490:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:2.0:1788179133.635536:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc906224000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5827:1875041472019968:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788179133.635567:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498e38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179133.638763:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179133.638879:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451017472 00000100:00100000:3.0:1788179133.638887:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451017472 00010000:00010000:3.0:1788179133.638935:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c498e0e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466200a expref: 41 pid: 5796 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179133.638973:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:3.0:1788179133.638982:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+41:2357:x1875041451017472:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788179133.638998:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179133.639004:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c498e0e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466200a expref: 41 pid: 5796 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.639017:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c498e0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466200a expref: 41 pid: 5796 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.639038:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c498e0e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466200a expref: 41 pid: 5796 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.639063:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:3.0:1788179133.639068:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498e38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.639077:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498e38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.639084:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498e38 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.639113:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179133.639189:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+40:2357:x1875041451017472:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 207us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179133.639196:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 39 00010000:00010000:0.0:1788179133.639437:0:5827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498e38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.639455:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498e38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179133.639495:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788179133.639499:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788179133.639531:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498e38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.639542:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498e38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.639551:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498e2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.639558:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498e2a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.639565:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498e2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.639570:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179133.639574:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498e2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.639581:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498e2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.639589:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:0.0:1788179133.639592:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179133.639596:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498e2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.639609:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498e2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.639620:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c498e31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.639626:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c498e31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.639632:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c498e31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.639637:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5800 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179133.639640:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c498e31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.639645:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c498e31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.639652:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bc909481900) 00010000:00010000:0.0:1788179133.639654:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179133.639656:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c498e31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.639662:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c498e31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.639701:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c498e23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662011 expref: 40 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.639714:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498e38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662011 expref: 39 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.639726:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:0.0:1788179133.639728:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788179133.639731:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c5600, rc 0) 00000100:00100000:0.0:1788179133.639754:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+39:10332:x1875041451017088:12345-192.168.202.2@tcp:101:stat.0 Request processed in 14668us (14943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179133.639761:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 53 00000100:00100000:1.0:1788179133.692748:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179133.692846:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451017728 00000100:00100000:0.0:1788179133.692880:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451017728 00000100:00100000:0.0:1788179133.692942:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 54 00000100:00100000:0.0:1788179133.692952:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+39:10338:x1875041451017728:12345-192.168.202.2@tcp:36:truncate.0 00010000:00010000:0.0:1788179133.693006:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179133.693033:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c498e38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662011 expref: 39 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.693051:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:0.0:1788179133.693056:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788179133.693364:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498e3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.693378:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498e3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179133.693388:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498e3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788179133.693430:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1788179133.693449:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000140a2156 reply state 00000000eb60bc0a transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498e3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179133.693464:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788179133.693560:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+41:10338:x1875041451017728:12345-192.168.202.2@tcp:36:truncate.0 Request processed in 609us (821us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788179133.693567:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 54 00000020:00080000:0.0:1788179133.693571:0:5796:0:(tgt_main.c:811:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788179133.696023:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179133.698525:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498e3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.698542:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498e3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.698550:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498e3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.698556:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179133.698561:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498e3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.698569:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498e3f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.698602:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:3.0:1788179133.698605:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179133.698610:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498e3f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.698616:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498e3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179133.870284:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179133.870453:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451017856 00000100:00100000:3.0:1788179133.870463:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451017856 00000100:00100000:3.0:1788179133.870521:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:3.0:1788179133.870532:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+40:10352:x1875041451017856:12345-192.168.202.2@tcp:101:stat.0 00010000:00010000:3.0:1788179133.870555:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179133.870577:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c498e46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662018 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.870640:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498e4d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.870654:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498e4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.870665:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498e4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.870679:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498e54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.870686:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498e54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.870710:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498e54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.870809:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c498e5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.870818:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c498e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.870825:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c498e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179133.870907:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788179133.870912:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788179133.870948:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c498e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.870961:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c498e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.870970:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498e4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.870976:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498e4d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.870984:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498e4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.870990:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5a00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179133.870995:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498e4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.871009:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498e4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.871022:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:3.0:1788179133.871025:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179133.871029:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498e4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.871036:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498e4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.871049:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498e54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.871055:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498e54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.871060:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498e54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.871065:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4400 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179133.871068:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498e54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.871237:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498e54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.871249:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bc903312600) 00010000:00010000:3.0:1788179133.871252:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179133.871255:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498e54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.871271:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498e54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.871379:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c498e46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662018 expref: 42 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.871393:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c498e5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662018 expref: 41 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179133.871401:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:3.0:1788179133.871403:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788179133.871406:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4e00, rc 0) 00000100:00100000:3.0:1788179133.871470:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+41:10352:x1875041451017856:12345-192.168.202.2@tcp:101:stat.0 Request processed in 939us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179133.871478:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:1.0:1788179133.964724:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179133.964823:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451018112 00000100:00100000:2.0:1788179133.964834:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451018112 00000100:00100000:2.0:1788179133.964914:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 56 00000100:00100000:2.0:1788179133.964935:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+41:10362:x1875041451018112:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788179133.964956:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179133.964977:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c498e62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466201f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179133.965099:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1788179133.965232:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c498e62 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466201f expref: 43 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179133.965247:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc9062cb300) 00010000:00010000:2.0:1788179133.965250:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788179133.965256:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c498e62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466201f expref: 43 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179133.965289:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c4a00, rc 0) 00000100:00100000:2.0:1788179133.965755:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+42:10362:x1875041451018112:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 820us (1041us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1788179133.965763:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 56 00000100:00100000:1.0:1788179133.969039:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179133.969128:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451018368 00000100:00100000:3.0:1788179133.969138:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451018368 00000100:00100000:3.0:1788179133.969202:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:3.0:1788179133.969213:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+42:10362:x1875041451018368:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:3.0:1788179133.969499:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+43:10362:x1875041451018368:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 286us (470us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1788179133.969506:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:1.0:1788179134.029466:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179134.029564:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451018624 00000100:00100000:0.0:1788179134.029575:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451018624 00000100:00100000:0.0:1788179134.029654:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00100000:0.0:1788179134.029665:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+43:10368:x1875041451018624:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1788179134.029688:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179134.029710:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498e70 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662026 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.029809:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c498e77 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.029824:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c498e5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662018 expref: 44 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.029840:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c498e77 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.029904:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c498e5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662018 expref: 44 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.029934:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c498e5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662018 expref: 44 pid: 5797 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179134.029967:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5827:1875041472020096:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788179134.030066:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9359ea3c0 going to sleep for 11 seconds 00000100:00080000:3.0:1788179134.030242:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788179134.033697:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179134.034111:0:11517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451018752 00000100:00100000:2.0:1788179134.034120:0:11517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451018752 00010000:00010000:2.0:1788179134.034163:0:11517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c498e5b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662018 expref: 45 pid: 5797 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179134.034206:0:11517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00100000:2.0:1788179134.034215:0:11517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+45:2356:x1875041451018752:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788179134.034231:0:11517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179134.034240:0:11517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c498e5b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662018 expref: 45 pid: 5797 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179134.034262:0:11517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c498e5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662018 expref: 45 pid: 5797 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179134.034286:0:11517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:2.0:1788179134.034292:0:11517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c498e77 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179134.034301:0:11517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c498e77 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179134.034308:0:11517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c498e77 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179134.034351:0:11517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788179134.034409:0:11517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+45:2356:x1875041451018752:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 195us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179134.034416:0:11517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 40 00010000:00010000:0.0:1788179134.035692:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c498e5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662018 expref: 44 pid: 5797 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179134.035714:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5827:1875041472020096:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788179134.035736:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c498e77 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.035745:0:5827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c498e77 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.035751:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c498e77 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179134.035772:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788179134.036007:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498e70 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662026 expref: 45 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.036024:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c498e77 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662026 expref: 44 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.036032:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:0.0:1788179134.036036:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788179134.036043:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317f200, rc 0) 00000100:00100000:0.0:1788179134.036226:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+44:10368:x1875041451018624:12345-192.168.202.2@tcp:101:bash.0 Request processed in 6562us (6769us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1788179134.036314:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00100000:1.0:1788179134.043423:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179134.043505:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451019008 00000100:00100000:0.0:1788179134.043516:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451019008 00000100:00100000:0.0:1788179134.043575:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 58 00000100:00100000:0.0:1788179134.043585:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+44:10368:x1875041451019008:12345-192.168.202.2@tcp:36:bash.0 00010000:00010000:0.0:1788179134.043883:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498e85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.043901:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498e85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.043912:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498e85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788179134.043979:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1788179134.044006:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000013319549 reply state 00000000413507ae transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498e85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179134.044015:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788179134.044124:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+47:10368:x1875041451019008:12345-192.168.202.2@tcp:36:bash.0 Request processed in 540us (710us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788179134.044132:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 58 00000020:00080000:0.0:1788179134.044137:0:5796:0:(tgt_main.c:811:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788179134.047909:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498e85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.047936:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498e85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.047959:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498e85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.047966:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f400 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179134.047971:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498e85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.047980:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498e85 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.047996:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:3.0:1788179134.047999:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179134.048003:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498e85 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.048009:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498e85 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179134.052001:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179134.052115:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451019136 00000100:00100000:3.0:1788179134.052124:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451019136 00000100:00100000:3.0:1788179134.052176:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 59 00000100:00100000:3.0:1788179134.052187:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+46:10368:x1875041451019136:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:3.0:1788179134.052211:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179134.052233:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c498e8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466202d expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.052351:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498e93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.052367:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c498e77 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662026 expref: 47 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.052382:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498e93 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.052414:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c498e77 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662026 expref: 47 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.052428:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c498e77 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662026 expref: 47 pid: 5827 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179134.052442:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b611f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1875041472020224:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788179134.052525:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9265d0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788179134.055174:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b611f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1875041472020224:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788179134.055208:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498e93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179134.055385:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179134.055750:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451019264 00000100:00100000:3.0:1788179134.055757:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451019264 00010000:00010000:3.0:1788179134.055789:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c498e77 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662026 expref: 48 pid: 5827 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179134.055925:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 41 00000100:00100000:3.0:1788179134.055935:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+48:2357:x1875041451019264:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788179134.055951:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179134.055958:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c498e77 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662026 expref: 48 pid: 5827 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.055988:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c498e77 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662026 expref: 48 pid: 5827 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.056010:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c498e77 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662026 expref: 48 pid: 5827 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.056024:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:3.0:1788179134.056029:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498e93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.056037:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.056044:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498e93 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.056072:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179134.056131:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+47:2357:x1875041451019264:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 198us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179134.056139:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 41 00010000:00010000:1.0:1788179134.056190:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179134.056198:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788179134.056263:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788179134.056268:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788179134.056289:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179134.056318:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c498e8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466202d expref: 47 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179134.056331:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498e93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466202d expref: 46 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179134.056338:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:1.0:1788179134.056341:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788179134.056344:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4400, rc 0) 00000100:00100000:1.0:1788179134.056367:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+46:10368:x1875041451019136:12345-192.168.202.2@tcp:101:bash.0 Request processed in 4183us (4378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179134.056373:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 59 00000100:00100000:1.0:1788179134.062393:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179134.062460:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451019520 00000100:00100000:3.0:1788179134.062470:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451019520 00000100:00100000:3.0:1788179134.062527:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:3.0:1788179134.062538:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9266ffc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+46:10368:x1875041451019520:12345-192.168.202.2@tcp:35:bash.0 00000100:00100000:3.0:1788179134.062768:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9266ffc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+47:10368:x1875041451019520:12345-192.168.202.2@tcp:35:bash.0 Request processed in 231us (383us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1788179134.062776:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:0.0:1788179134.150030:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179134.150184:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451019776 00000100:00100000:2.0:1788179134.150195:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451019776 00000100:00100000:2.0:1788179134.150256:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00100000:2.0:1788179134.150267:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+47:10378:x1875041451019776:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788179134.150292:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179134.150315:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c498e9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662034 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179134.150435:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1788179134.150692:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c498e9a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662034 expref: 49 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179134.150708:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc9062cb300) 00010000:00010000:2.0:1788179134.150711:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788179134.150716:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c498e9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662034 expref: 49 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179134.150730:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c4000, rc 0) 00000100:00100000:2.0:1788179134.151163:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+48:10378:x1875041451019776:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 896us (1141us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1788179134.151171:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00100000:3.0:1788179134.157454:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179134.159997:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451019904 00000100:00100000:0.0:1788179134.160011:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451019904 00000100:00100000:0.0:1788179134.160120:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:0.0:1788179134.160130:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+48:10378:x1875041451019904:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:0.0:1788179134.160205:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498ea8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160233:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498ea8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160245:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498ea8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160259:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498eaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160266:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498eaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160272:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498eaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160364:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498eb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160372:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160378:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788179134.160415:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160427:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498ea8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160433:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498ea8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160450:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498ea8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160456:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317ee00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179134.160460:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498ea8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160467:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498ea8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160478:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:0.0:1788179134.160481:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179134.160484:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498ea8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160490:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498ea8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160503:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498eaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160509:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498eaf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160515:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498eaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160519:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317e200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179134.160522:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498eaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160535:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498eaf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160542:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bc9062cbf00) 00010000:00010000:0.0:1788179134.160544:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179134.160546:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498eaf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160551:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498eaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160563:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160569:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498eb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160574:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160578:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317fc00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179134.160581:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160586:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498eb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160592:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:0.0:1788179134.160594:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179134.160597:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498eb6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.160609:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498eb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179134.160683:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+48:10378:x1875041451019904:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 554us (3238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179134.160689:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:1.0:1788179134.166249:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179134.166335:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451020160 00000100:00100000:3.0:1788179134.166345:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451020160 00000100:00100000:3.0:1788179134.166442:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:3.0:1788179134.166453:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+48:10378:x1875041451020160:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:3.0:1788179134.166726:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+49:10378:x1875041451020160:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 274us (485us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788179134.166734:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:1.0:1788179134.251212:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179134.256086:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451020416 00000100:00100000:0.0:1788179134.256102:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451020416 00000100:00100000:0.0:1788179134.256179:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 62 00000100:00100000:0.0:1788179134.256190:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+49:10381:x1875041451020416:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788179134.256216:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179134.256242:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498ebd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466203b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.256323:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498ec4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.256336:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498ec4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.256346:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498ec4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.256360:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498ecb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.256366:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498ecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.256372:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498ecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.256521:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498ed2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.256531:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.256539:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179134.256548:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788179134.256643:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498ec4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.256651:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498ec4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.256657:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498ec4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.256663:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317e200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179134.256668:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498ec4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.256675:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498ec4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.256688:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:0.0:1788179134.256691:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179134.256696:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498ec4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.256712:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498ec4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.256726:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498ecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.256732:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498ecb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.256738:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498ecb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.256744:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317ee00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179134.256747:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498ecb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.256753:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498ecb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.256760:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bc9062cbf00) 00010000:00010000:0.0:1788179134.256762:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179134.256765:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498ecb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.256770:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498ecb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.256809:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498ebd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466203b expref: 52 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.256824:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498ed2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466203b expref: 51 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.256838:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:0.0:1788179134.256840:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788179134.256843:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317e400, rc 0) 00000100:00100000:0.0:1788179134.256980:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+51:10381:x1875041451020416:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 792us (5777us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788179134.256988:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 62 00000100:00100000:1.0:1788179134.266005:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179134.266144:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451020544 00000100:00100000:3.0:1788179134.266412:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451020544 00000100:00100000:3.0:1788179134.266481:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00100000:3.0:1788179134.266492:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+51:10381:x1875041451020544:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:3.0:1788179134.266564:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498ee0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.266582:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.266594:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.266623:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.266631:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498ee0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.266638:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.266664:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5a00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179134.266668:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.266676:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498ee0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.266688:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:3.0:1788179134.266691:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788179134.266695:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498ee0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.266701:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498ee0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179134.266813:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+51:10381:x1875041451020544:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 323us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179134.266820:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00100000:1.0:1788179134.279046:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179134.279210:0:11517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451020672 00000100:00100000:2.0:1788179134.279233:0:11517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451020672 00000100:00100000:2.0:1788179134.279310:0:11517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:2.0:1788179134.279321:0:11517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+51:2355:x1875041451020672:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788179134.279337:0:11517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179134.279363:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498ed2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466203b expref: 51 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179134.279382:0:11517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:2.0:1788179134.279387:0:11517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788179134.279433:0:11517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+50:2355:x1875041451020672:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 114us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179134.279454:0:11517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:1.0:1788179134.287018:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179134.288426:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451020928 00000100:00100000:0.0:1788179134.288441:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451020928 00000100:00100000:0.0:1788179134.288570:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:0.0:1788179134.288580:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+50:10381:x1875041451020928:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:0.0:1788179134.288845:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+51:10381:x1875041451020928:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 265us (1838us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788179134.288870:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:1.0:1788179134.607662:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179134.607766:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451021184 00000100:00100000:0.0:1788179134.607776:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451021184 00000100:00100000:0.0:1788179134.607878:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 64 00000100:00100000:0.0:1788179134.607890:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+51:10399:x1875041451021184:12345-192.168.202.2@tcp:101:cat.0 00010000:00010000:0.0:1788179134.607922:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179134.607943:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498ee7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662042 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.608058:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498eee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.608073:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498eee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.608092:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498eee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179134.608104:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788179134.608230:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498ee7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662042 expref: 54 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.608250:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498eee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662042 expref: 53 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.608258:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:0.0:1788179134.608261:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788179134.608264:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317ee00, rc 0) 00000100:00100000:0.0:1788179134.608326:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+53:10399:x1875041451021184:12345-192.168.202.2@tcp:101:cat.0 Request processed in 439us (674us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788179134.608333:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 64 00000100:00100000:1.0:1788179134.689537:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179134.689670:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451021312 00000100:00100000:3.0:1788179134.689681:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451021312 00000100:00100000:3.0:1788179134.689746:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 65 00000100:00100000:3.0:1788179134.689758:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+53:10400:x1875041451021312:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1788179134.689784:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179134.689805:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498efc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662049 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.689922:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498f03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.689955:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498f03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.689967:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498f03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179134.690030:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1788179134.690034:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788179134.690057:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498f03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.690083:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498efc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662049 expref: 55 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.690102:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498f03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662049 expref: 54 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179134.690110:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:3.0:1788179134.690112:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788179134.690116:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b5600, rc 0) 00000100:00100000:3.0:1788179134.690180:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+54:10400:x1875041451021312:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 424us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179134.690187:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 65 00000100:00100000:1.0:1788179134.708585:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179134.708718:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451021696 00000100:00100000:3.0:1788179134.708729:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451021696 00000100:00100000:3.0:1788179134.708800:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:3.0:1788179134.708811:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+54:10400:x1875041451021696:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:3.0:1788179134.709215:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+55:10400:x1875041451021696:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 404us (639us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788179134.709238:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 18 00010000:00010000:1.0:1788179134.720057:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179134.725070:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179134.725165:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451021824 00000100:00100000:2.0:1788179134.725175:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451021824 00000100:00100000:2.0:1788179134.725250:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:2.0:1788179134.725260:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+55:10400:x1875041451021824:12345-192.168.202.2@tcp:103:lfs.0 00010000:00010000:2.0:1788179134.725278:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788179134.725305:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c498e93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466202d expref: 55 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179134.725330:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498eee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662042 expref: 54 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179134.725343:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c498d9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fee expref: 53 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179134.725354:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:2.0:1788179134.725385:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788179134.725451:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+52:10400:x1875041451021824:12345-192.168.202.2@tcp:103:lfs.0 Request processed in 192us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179134.725459:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:1.0:1788179134.737438:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179134.737662:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451021952 00000100:00100000:0.0:1788179134.737673:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451021952 00000100:00100000:0.0:1788179134.737791:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 66 00000100:00100000:0.0:1788179134.737802:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+52:10400:x1875041451021952:12345-192.168.202.2@tcp:58:lfs.0 00010000:00010000:0.0:1788179134.737955:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498f0a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.737971:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498f0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.737983:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498f0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788179134.739462:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788179134.739678:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788179134.743671:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788179134.743865:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+52:10400:x1875041451021952:12345-192.168.202.2@tcp:58:lfs.0 Request processed in 6042us (6421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179134.743879:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 66 00000100:00100000:1.0:1788179134.770771:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179134.771548:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451022080 00000100:00100000:0.0:1788179134.771559:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451022080 00000100:00100000:0.0:1788179134.771622:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 67 00000100:00100000:0.0:1788179134.771632:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+52:10402:x1875041451022080:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788179134.771654:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179134.771678:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498f11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662050 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.771747:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c498f18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.771763:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c498f18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.771774:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c498f18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.771789:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498f1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.771796:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.772358:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.772574:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498f26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.772584:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498f26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.772592:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498f26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179134.772632:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788179134.772637:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788179134.772658:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498f26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.772670:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498f26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.772677:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c498f18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.772683:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c498f18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.772689:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c498f18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.772694:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317fa00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179134.772699:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c498f18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.772717:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c498f18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.772730:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:0.0:1788179134.772733:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179134.772738:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c498f18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.772744:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c498f18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.772759:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.772765:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498f1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.772771:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498f1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.772776:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317ee00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179134.772779:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498f1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.772784:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498f1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.772791:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bc9062cb800) 00010000:00010000:0.0:1788179134.772793:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179134.772796:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498f1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.772811:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c498f1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.773020:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c498f11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662050 expref: 54 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.773034:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498f26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662050 expref: 53 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179134.773042:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cbf00) 00010000:00010000:0.0:1788179134.773045:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788179134.773047:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317e400, rc 0) 00000100:00100000:0.0:1788179134.773105:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+53:10402:x1875041451022080:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 1473us (2343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179134.773113:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 67 00000001:00080000:3.0:1788179135.260173:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000004:00080000:3.0:1788179135.260204:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788179135.260228:0:5818:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bc904fb5900 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788179135.260233:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9bc907193e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bc904fb5780 00000020:00080000:3.0:1788179135.260236:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9bc907193100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bc92655c400 00000001:00080000:3.0:1788179135.260292:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000020:00080000:3.0:1788179135.260317:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:1.0:1788179135.260502:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788179135.260522:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472020352:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788179135.260594:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179135.260700:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472020352 00000100:00100000:0.0:1788179135.260708:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472020352 00000100:00100000:0.0:1788179135.260759:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788179135.260768:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1875041472020352:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788179135.260793:0:6591:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00000020:00080000:3.0:1788179135.260799:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00080000:3.0:1788179135.260808:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1788179135.260835:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9572bb, atime: 0x6a9572bc, ctime: 0x6a9572bb, blocks: 0xb 00010000:00010000:0.0:1788179135.260844:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e714b189/0xaa4c98508c498f2d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.260883:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=331s v=(0 0) 00010000:00010000:0.0:1788179135.260887:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788179135.260920:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e714b189/0xaa4c98508c498f2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.260945:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e714b189/0xaa4c98508c498f2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.260957:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e714b189/0xaa4c98508c498f2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.260965:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e714b189/0xaa4c98508c498f2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.260988:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788179135.261589:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788179135.261596:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e714b189/0xaa4c98508c498f2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.261606:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317fa00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:3.0:1788179135.261611:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e714b189/0xaa4c98508c498f2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.261620:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e714b189/0xaa4c98508c498f2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.261637:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e714b189/0xaa4c98508c498f2d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.261644:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e714b189/0xaa4c98508c498f2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.261671:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179135.261672:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179135.261674:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179135.261758:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1875041472020352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 990us (1162us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788179135.261766:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:2.0:1788179135.261924:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bc9358fb800/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788179135.261932:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472020352:0@lo:6:osp-syn-1-0.0 00000040:00080000:2.0:1788179135.552799:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788179135.552809:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788179135.552892:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788179135.552900:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788179135.553030:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc906224000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1875041472020480:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788179135.553126:0:11535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc932099e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788179135.572158:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179135.595140:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451022208 00000100:00100000:3.0:1788179135.595154:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451022208 00000100:00100000:3.0:1788179135.595244:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:3.0:1788179135.595255:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:334bb25c-6762-4beb-8a84-3a838cbc7e80+12:10413:x1875041451022208:12345-192.168.202.2@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788179135.595347:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:334bb25c-6762-4beb-8a84-3a838cbc7e80+12:10413:x1875041451022208:12345-192.168.202.2@tcp:900:lhsmtool_posix.0 Request processed in 94us (23200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179135.595354:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:3.0:1788179135.595402:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc906224000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1875041472020480:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788179135.611623:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179135.611671:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451022336 00000100:00100000:0.0:1788179135.611681:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451022336 00000100:00100000:0.0:1788179135.611750:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 68 00000100:00100000:0.0:1788179135.611760:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+11:10413:x1875041451022336:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788179135.611792:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788179135.612063:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+11:10413:x1875041451022336:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 303us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179135.612070:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 68 00000100:00100000:1.0:1788179135.636459:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179135.637254:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451022464 00000100:00100000:3.0:1788179135.637267:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451022464 00000100:00100000:3.0:1788179135.637342:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 69 00000100:00100000:3.0:1788179135.637354:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+11:10413:x1875041451022464:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788179135.637432:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498f34 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.637451:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498f34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.637465:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498f34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.637527:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498f3b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.637544:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498f3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.637552:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498f3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.637582:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498f42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.637591:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498f42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.637599:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498f42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179135.637637:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788179135.637642:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788179135.637654:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498f42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.637665:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498f34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.637670:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498f34 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.637678:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498f34 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.637684:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5a00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179135.637688:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498f34 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.637703:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498f34 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.637718:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bc903340c00) 00010000:00010000:3.0:1788179135.637721:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179135.637727:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498f34 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.637733:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498f34 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.637746:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498f3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.637752:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498f3b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.637758:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498f3b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.637763:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179135.637765:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498f3b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.637771:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498f3b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.637778:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9bc903312000) 00010000:00010000:3.0:1788179135.637781:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179135.637783:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498f3b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.637799:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498f3b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.637818:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498f42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.637824:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498f42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.638021:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498f42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.638028:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4c00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179135.638032:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498f42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.638039:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498f42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.638048:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cbf00) 00010000:00010000:3.0:1788179135.638050:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179135.638053:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498f42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.638058:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498f42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179135.638146:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+11:10413:x1875041451022464:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 Request processed in 794us (1696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179135.638155:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 69 00000100:00100000:0.0:1788179135.647177:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179135.647328:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451022720 00000100:00100000:2.0:1788179135.647345:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451022720 00000100:00100000:2.0:1788179135.647413:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 70 00000100:00100000:2.0:1788179135.647424:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+11:10413:x1875041451022720:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788179135.647451:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179135.647472:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c498f49 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662057 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.647572:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498f50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.647585:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498f50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.647596:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498f50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179135.647621:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788179135.647819:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498f50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.647828:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498f50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.647834:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498f50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.647839:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5e00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179135.647844:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498f50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.648009:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498f50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.648022:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cbf00) 00010000:00010000:2.0:1788179135.648025:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788179135.648030:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498f50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.648102:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c498f50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.648184:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c498f49 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662057 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.648205:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bc903340c00) 00010000:00010000:0.0:1788179135.648208:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788179135.648212:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c498f49 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662057 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.648223:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c4600, rc 0) 00000100:00100000:0.0:1788179135.648290:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+12:10413:x1875041451022720:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 867us (1119us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1788179135.648298:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 70 00000100:00100000:0.0:1788179135.658763:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179135.659587:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451022848 00000100:00100000:1.0:1788179135.659601:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451022848 00000100:00100000:1.0:1788179135.659657:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 71 00000100:00100000:1.0:1788179135.659669:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+12:10413:x1875041451022848:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788179135.659716:0:5827:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788179135.659961:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+12:10413:x1875041451022848:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 294us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179135.659970:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 71 00000100:00100000:1.0:1788179135.665396:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179135.665615:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451023104 00000100:00100000:0.0:1788179135.665625:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451023104 00000100:00100000:0.0:1788179135.665717:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 72 00000100:00100000:0.0:1788179135.665729:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+12:10413:x1875041451023104:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788179135.665757:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179135.665760:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788179135.666278:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c498f03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662049 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.666294:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:0.0:1788179135.666298:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788179135.666312:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498f5e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466205e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788179135.667270:0:5798:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788179135.667559:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498f65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.667574:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498f65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.667584:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498f65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.667644:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498f5e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466205e expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.667662:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498f65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466205e expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.667670:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bc9062cbc00) 00010000:00010000:0.0:1788179135.667673:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788179135.667676:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317f000, rc 0) 00000100:00100000:0.0:1788179135.667748:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+13:10413:x1875041451023104:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 2021us (2360us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1788179135.667755:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 72 00000100:00100000:1.0:1788179135.672912:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179135.672999:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451023360 00000100:00100000:3.0:1788179135.673009:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451023360 00000100:00100000:3.0:1788179135.673064:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 73 00000100:00100000:3.0:1788179135.673075:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+13:10413:x1875041451023360:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788179135.673128:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179135.673154:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498f65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466205e expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.673170:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bc9062cbc00) 00010000:00010000:3.0:1788179135.673180:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788179135.673201:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498f73 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.673215:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498f73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.673224:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498f73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.673238:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498f7a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x71d2e1bd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.673245:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498f7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x71d2e1bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.673251:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498f7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x71d2e1bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.673497:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498f73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.673515:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498f73 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.673522:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498f73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.673528:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4c00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179135.673532:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498f73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.673539:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498f73 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.673549:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:3.0:1788179135.673551:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179135.673555:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498f73 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.673562:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c498f73 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.673572:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498f7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x71d2e1bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.673578:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498f7a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x71d2e1bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.673584:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498f7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x71d2e1bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.673589:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179135.673598:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498f7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x71d2e1bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.673604:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498f7a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x71d2e1bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.673611:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x71d2e1bd (ffff9bc903312000) 00010000:00010000:3.0:1788179135.673614:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179135.673617:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498f7a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x71d2e1bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.673622:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c498f7a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x71d2e1bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179135.673694:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+12:10413:x1875041451023360:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 621us (798us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788179135.673701:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 73 00000100:00100000:0.0:1788179135.675524:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179135.675581:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451023488 00000100:00100000:3.0:1788179135.675589:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451023488 00000100:00100000:3.0:1788179135.675634:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 74 00000100:00100000:3.0:1788179135.675643:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f82ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+12:10413:x1875041451023488:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788179135.675660:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179135.675679:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498f81 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662065 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.675708:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498f88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.675720:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498f88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.675741:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498f88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.675822:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c498f81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662065 expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.675834:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498f88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662065 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.675840:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bc903312100) 00010000:00010000:3.0:1788179135.675842:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788179135.675844:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4600, rc 0) 00000100:00100000:3.0:1788179135.675911:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f82ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+13:10413:x1875041451023488:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 259us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179135.675917:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 74 00000100:00100000:3.0:1788179135.680568:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179135.680684:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451023744 00000100:00100000:0.0:1788179135.680693:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451023744 00000100:00100000:0.0:1788179135.680747:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 75 00000100:00100000:0.0:1788179135.680758:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+13:10413:x1875041451023744:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788179135.680844:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498f8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.680918:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498f8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.680932:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498f8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788179135.681232:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1788179135.681242:0:5827:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 331744391474ns, next at 332744389213ns, rc = 0 00000004:00010000:0.0:1788179135.681337:0:5827:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000079aed7c4 reply state 000000007d472a89 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498f8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179135.681348:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788179135.681448:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+15:10413:x1875041451023744:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 691us (888us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1788179135.681456:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 75 00010000:00010000:0.0:1788179135.683352:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498f8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.683368:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498f8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.683376:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498f8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.683382:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f400 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179135.683386:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498f8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.683393:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498f8f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.683422:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bc903312100) 00010000:00010000:0.0:1788179135.683425:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788179135.683430:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498f8f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.683435:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498f8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179135.690560:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179135.690657:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451023872 00000100:00100000:1.0:1788179135.690669:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451023872 00000100:00100000:1.0:1788179135.690727:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 76 00000100:00100000:1.0:1788179135.690738:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+14:10413:x1875041451023872:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788179135.690765:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179135.690785:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c498f96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466206c expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.690836:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c498f96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466206c expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.690884:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c498f96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466206c expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.690916:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bc903312100) 00010000:00010000:1.0:1788179135.690920:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788179135.690925:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc92e12c400, rc 0) 00000100:00100000:1.0:1788179135.690985:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+15:10413:x1875041451023872:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 250us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179135.690992:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 76 00000100:00100000:3.0:1788179135.704235:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179135.704385:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451024000 00000100:00100000:1.0:1788179135.704393:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451024000 00000100:00100000:1.0:1788179135.704438:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:1.0:1788179135.704445:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1875041451024000:12345-192.168.202.2@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1788179135.704474:0:6590:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 334bb25c-6762-4beb-8a84-3a838cbc7e80@192.168.202.2@tcp t0 exp 0000000000000000 cur 331 last 0 00000020:00000080:1.0:1788179135.704496:0:6590:0:(genops.c:1407:class_connect()) connect: client 334bb25c-6762-4beb-8a84-3a838cbc7e80, cookie 0xaa4c98508c498f9d 00002000:00100000:1.0:1788179135.704507:0:6590:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 334bb25c-6762-4beb-8a84-3a838cbc7e80/ffff9bc926724800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211371b ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788179135.704526:0:6590:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788179135.704733:0:6590:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788179135.704760:0:6590:0:(import.c:65:import_set_state_nolock()) ffff9bc926727000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788179135.705994:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2353:x1875041451024000:12345-192.168.202.2@tcp:8:lhsmtool_posix.0 Request processed in 1542us (1763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179135.706003:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 25 00000040:00080000:2.0:1788179135.708554:0:11850:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788179135.708562:0:11850:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788179135.708586:0:11850:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788179135.708590:0:11850:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788179135.714243:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179135.714763:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451024128 00000100:00100000:3.0:1788179135.714772:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451024128 00000100:00100000:3.0:1788179135.714832:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00100000:3.0:1788179135.714840:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:0:x1875041451024128:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788179135.715865:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788179135.748582:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788179135.752701:0:6618:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 334bb25c-6762-4beb-8a84-3a838cbc7e80 00000001:00080000:1.0:1788179135.752721:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:3.0:1788179135.756063:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:0:x1875041451024128:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 41210us (41814us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788179135.756077:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00100000:3.0:1788179135.765818:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179135.765964:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451024384 00000100:00100000:0.0:1788179135.765972:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451024384 00000100:00100000:0.0:1788179135.766025:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:0.0:1788179135.766036:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+15:10413:x1875041451024384:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788179135.766268:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+16:10413:x1875041451024384:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 234us (469us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788179135.766275:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:2.0:1788179135.769712:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179135.770654:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451024640 00000100:00100000:3.0:1788179135.770666:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451024640 00000100:00100000:2.0:1788179135.770772:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 77 00000100:00100000:2.0:1788179135.770783:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+16:10413:x1875041451024640:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788179135.770929:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+16:10413:x1875041451024640:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 148us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179135.770938:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 77 00000100:00100000:2.0:1788179135.773735:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179135.773803:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451024768 00000100:00100000:1.0:1788179135.773817:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451024768 00000100:00100000:1.0:1788179135.773888:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 78 00000100:00100000:1.0:1788179135.773898:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+16:10413:x1875041451024768:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788179135.773927:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179135.773949:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c498fa4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662073 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.774012:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c498fab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.774023:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c498fab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.774032:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c498fab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788179135.774067:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788179135.774086:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c498fab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.774108:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c498fa4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662073 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.774120:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c498fab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662073 expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.774125:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bc903312100) 00010000:00010000:1.0:1788179135.774127:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788179135.774130:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc92e12d600, rc 0) 00000100:00100000:1.0:1788179135.774182:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+17:10413:x1875041451024768:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 286us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179135.774189:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 78 00000100:00100000:2.0:1788179135.781082:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179135.781150:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451024896 00000100:00100000:0.0:1788179135.781159:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451024896 00000100:00100000:0.0:1788179135.781213:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:0.0:1788179135.781224:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906226a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2357:x1875041451024896:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788179135.781242:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179135.781259:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b853af22/0xaa4c98508c498fb2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466207a expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788179135.781282:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9572be, blocks: 0x1 00010000:00010000:0.0:1788179135.781297:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=331s v=(0 0) 00010000:00010000:0.0:1788179135.781300:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788179135.781311:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b853af22/0xaa4c98508c498fb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466207a expref: 6 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.781325:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b853af22/0xaa4c98508c498fb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466207a expref: 6 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.781335:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317ee00, rc 0) 00000100:00100000:0.0:1788179135.781378:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906226a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2357:x1875041451024896:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 157us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179135.781382:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:0.0:1788179135.786765:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179135.786828:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451025152 00000100:00100000:3.0:1788179135.786837:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451025152 00000100:00100000:3.0:1788179135.786907:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 79 00000100:00100000:3.0:1788179135.786917:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f82e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+17:10413:x1875041451025152:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788179135.787006:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f82e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+17:10413:x1875041451025152:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 90us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179135.787011:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 79 00000100:00100000:0.0:1788179135.789767:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179135.789819:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451025280 00000100:00100000:2.0:1788179135.789827:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451025280 00000100:00100000:2.0:1788179135.789882:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:2.0:1788179135.789891:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f82c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:10413:x1875041451025280:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788179135.789916:0:7778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179135.789936:0:7778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000175b3e1/0xaa4c98508c498fb9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662081 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.789969:0:7778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b853af22/0xaa4c98508c498fb2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466207a expref: 7 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.789977:0:7778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179135.789981:0:7778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179135.789986:0:7778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000175b3e1/0xaa4c98508c498fb9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662081 expref: 7 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.790016:0:7778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b853af22/0xaa4c98508c498fb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466207a expref: 7 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.790041:0:7778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b853af22/0xaa4c98508c498fb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466207a expref: 7 pid: 6589 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179135.790054:0:7778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9359baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7778:1875041472020608:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788179135.790133:0:7778:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc803c6f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788179135.796102:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179135.796131:0:11517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451025408 00000100:00100000:0.0:1788179135.796138:0:11517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451025408 00010000:00010000:0.0:1788179135.796175:0:11517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b853af22/0xaa4c98508c498fb2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466207a expref: 8 pid: 6589 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179135.796211:0:11517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:0.0:1788179135.796220:0:11517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90710c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2356:x1875041451025408:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179135.796236:0:11517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179135.796255:0:11517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b853af22/0xaa4c98508c498fb2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466207a expref: 8 pid: 6589 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.796265:0:11517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b853af22/0xaa4c98508c498fb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466207a expref: 8 pid: 6589 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.796300:0:11517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788179135.796304:0:11517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788179135.796310:0:11517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000175b3e1/0xaa4c98508c498fb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662081 expref: 8 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.796317:0:11517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000175b3e1/0xaa4c98508c498fb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662081 expref: 8 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.796345:0:11517:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000175b3e1/0xaa4c98508c498fb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662081 expref: 8 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179135.796355:0:11517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f82c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11517:1875041472020736:192.168.202.2@tcp:105: 00000100:00100000:0.0:1788179135.796417:0:11517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9359eaf00 going to sleep for 11 seconds 00010000:00010000:0.0:1788179135.796549:0:7778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b853af22/0xaa4c98508c498fb2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466207a expref: 8 pid: 6589 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179135.796561:0:7778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9359baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7778:1875041472020608:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788179135.796577:0:7778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000175b3e1/0xaa4c98508c498fb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662081 expref: 7 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.796585:0:7778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c4000, rc 0) 00000100:00100000:0.0:1788179135.796607:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f82c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:10413:x1875041451025280:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 6719us (6847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179135.796612:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:2.0:1788179135.802127:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179135.802411:0:11517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f82c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11517:1875041472020736:192.168.202.2@tcp:105: 00010000:00010000:0.0:1788179135.802434:0:11517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179135.802489:0:11517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90710c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2356:x1875041451025408:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 6270us (6394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179135.802497:0:11517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:1.0:1788179135.802729:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451025536 00000100:00100000:1.0:1788179135.802735:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451025536 00002000:00100000:1.0:1788179135.802765:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9bc9359baa00 x1875041451025536/t0(0) o4->334bb25c-6762-4beb-8a84-3a838cbc7e80@192.168.202.2@tcp:151/0 lens 504/0 e 0 to 0 dl 1788179146 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788179135.802773:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bc9359baa00 with x1875041451025536 ext(0->8) 00002000:00010000:1.0:1788179135.802776:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bc9359baa00 00000100:00100000:1.0:1788179135.802868:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:1.0:1788179135.802876:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2356:x1875041451025536:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788179135.803749:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2356:x1875041451025536:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 Request processed in 871us (1627us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788179135.803756:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00002000:00100000:1.0:1788179135.803761:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9bc9359baa00 x1875041451025536/t4294967302(0) o4->334bb25c-6762-4beb-8a84-3a838cbc7e80@192.168.202.2@tcp:151/0 lens 504/448 e 0 to 0 dl 1788179146 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788179135.803768:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bc9359baa00 with x1875041451025536 ext(0->8) 00002000:00010000:1.0:1788179135.803771:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bc9359baa00 00000100:00100000:3.0:1788179135.806333:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179135.806759:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451025664 00000100:00100000:1.0:1788179135.806769:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451025664 00000100:00100000:1.0:1788179135.806827:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 80 00000100:00100000:1.0:1788179135.806837:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+17:10413:x1875041451025664:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788179135.826582:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+17:10413:x1875041451025664:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 Request processed in 19738us (20251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179135.826595:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 80 00000001:00080000:0.0:1788179135.826926:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1788179135.826938:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788179135.826958:0:5818:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1788179135.827323:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1788179135.827335:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788179135.827389:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472020864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788179135.827442:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179135.827536:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472020864 00000100:00100000:1.0:1788179135.827543:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472020864 00000100:00100000:1.0:1788179135.827601:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788179135.827609:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f82c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472020864:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788179135.827743:0:6589:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788179135.827747:0:6589:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788179135 00002000:00010000:1.0:1788179135.827749:0:6589:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788179135.827751:0:6589:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788179134 -> 1788179135 00002000:00010000:1.0:1788179135.827754:0:6589:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788179135.827787:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f82c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875041472020864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 179us (345us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788179135.827793:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1788179135.827927:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bc935a36a00/2, rc 0, transno 4294967303 00000100:00100000:0.0:1788179135.827934:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472020864:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1788179135.828160:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788179135.841000:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179135.841328:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451025792 00000100:00100000:0.0:1788179135.841342:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451025792 00000100:00100000:0.0:1788179135.841396:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 30 00000100:00100000:0.0:1788179135.841407:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2356:x1875041451025792:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788179135.869745:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1788179135.869761:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1788179135.869822:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2356:x1875041451025792:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 Request processed in 28411us (28827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179135.869834:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 30 00000100:00100000:2.0:1788179135.878761:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179135.879062:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451026048 00000100:00100000:3.0:1788179135.879072:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451026048 00000100:00100000:3.0:1788179135.879126:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 81 00000100:00100000:3.0:1788179135.879137:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+13:10413:x1875041451026048:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788179135.879232:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179135.879258:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c498fab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662073 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.879275:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bc903312100) 00010000:00010000:3.0:1788179135.879280:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788179135.879308:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c498fc0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.879319:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c498fc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.879339:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c498fc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788179135.879539:0:5827:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e4f7b096 reply state 000000007fdf6f5f transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c498fc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179135.879546:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788179135.879627:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+14:10413:x1875041451026048:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 492us (875us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788179135.879635:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 81 00010000:00010000:3.0:1788179135.881521:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c498fc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.881538:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c498fc0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.881545:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c498fc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.881552:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179135.881557:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c498fc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.881564:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c498fc0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.881580:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bc903312100) 00010000:00010000:3.0:1788179135.881583:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179135.881587:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c498fc0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.881611:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c498fc0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179135.882091:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179135.882383:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451026176 00000100:00100000:1.0:1788179135.882391:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451026176 00000100:00100000:1.0:1788179135.882458:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:1.0:1788179135.882465:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b68dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2357:x1875041451026176:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788179135.882654:0:6589:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788179135.882657:0:6589:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788179135 -> 1788179133 00002000:00010000:1.0:1788179135.882659:0:6589:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788179132 00002000:00010000:1.0:1788179135.882661:0:6589:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788179135 -> 1788179133 00002000:00010000:1.0:1788179135.882662:0:6589:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788179135.882709:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b68dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2357:x1875041451026176:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 244us (621us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788179135.882714:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:0.0:1788179135.884686:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179135.884793:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451026432 00000100:00100000:2.0:1788179135.884801:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451026432 00000100:00100000:2.0:1788179135.884969:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 82 00000100:00100000:2.0:1788179135.884981:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+13:10413:x1875041451026432:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788179135.885042:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498fc7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.885055:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498f88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662065 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.885061:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498fc7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.885086:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498f88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662065 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.885108:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498f88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662065 expref: 13 pid: 5796 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179135.885118:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b68f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1875041472020992:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788179135.885196:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc803c6f480 going to sleep for 11 seconds 00000100:00100000:0.0:1788179135.886458:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b68f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1875041472020992:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788179135.886476:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498fc7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179135.887223:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179135.887381:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451026560 00000100:00100000:2.0:1788179135.887389:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451026560 00010000:00010000:2.0:1788179135.887417:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498f88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662065 expref: 14 pid: 5796 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179135.887452:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:2.0:1788179135.887461:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+14:2356:x1875041451026560:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788179135.887475:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179135.887482:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498f88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662065 expref: 14 pid: 5796 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.887493:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498f88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662065 expref: 14 pid: 5796 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.887514:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c498f88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662065 expref: 14 pid: 5796 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.887529:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bc903312100) 00010000:00010000:2.0:1788179135.887534:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498fc7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.887556:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.887561:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498fc7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.887583:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788179135.887623:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+13:2356:x1875041451026560:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 163us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179135.887630:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 43 00010000:00010000:0.0:1788179135.887710:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.887718:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.887755:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.887760:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498fc7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.887764:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498fc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.887768:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179135.887771:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498fc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.887775:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498fc7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.887781:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bc903312100) 00010000:00010000:0.0:1788179135.887783:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788179135.887785:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498fc7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.887789:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c498fc7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179135.887834:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+12:10413:x1875041451026432:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 Request processed in 2857us (3158us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788179135.887839:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 82 00000100:00100000:0.0:1788179135.889666:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179135.889718:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451026688 00000100:00100000:2.0:1788179135.889725:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451026688 00000100:00100000:2.0:1788179135.889782:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00100000:2.0:1788179135.889789:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2357:x1875041451026688:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788179135.889821:0:7778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000da95f6ae/0xaa4c98508c498fce lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.889835:0:7778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000175b3e1/0xaa4c98508c498fb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662081 expref: 7 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.889841:0:7778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179135.889844:0:7778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788179135.889874:0:7778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da95f6ae/0xaa4c98508c498fce lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.889922:0:7778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000175b3e1/0xaa4c98508c498fb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662081 expref: 7 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.889954:0:7778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000175b3e1/0xaa4c98508c498fb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662081 expref: 7 pid: 7778 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179135.889970:0:7778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b68e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7778:1875041472021120:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788179135.890030:0:7778:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc803c6fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788179135.891646:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179135.891695:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451026816 00000100:00100000:1.0:1788179135.891715:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451026816 00010000:00010000:1.0:1788179135.891745:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000175b3e1/0xaa4c98508c498fb9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662081 expref: 8 pid: 7778 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179135.891789:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:1.0:1788179135.891798:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b68ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2357:x1875041451026816:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788179135.891808:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788179135.891829:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000175b3e1/0xaa4c98508c498fb9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662081 expref: 8 pid: 7778 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.891840:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000175b3e1/0xaa4c98508c498fb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662081 expref: 8 pid: 7778 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.891881:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788179135.891886:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788179135.891891:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da95f6ae/0xaa4c98508c498fce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.891957:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da95f6ae/0xaa4c98508c498fce lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.891977:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788179135.892022:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b68ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2357:x1875041451026816:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 224us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179135.892029:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 44 00010000:00010000:0.0:1788179135.892413:0:7778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000175b3e1/0xaa4c98508c498fb9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662081 expref: 7 pid: 7778 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179135.892444:0:7778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b68e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7778:1875041472021120:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788179135.892466:0:7778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da95f6ae/0xaa4c98508c498fce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.892475:0:7778:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da95f6ae/0xaa4c98508c498fce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.892482:0:7778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da95f6ae/0xaa4c98508c498fce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.892507:0:7778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000da95f6ae/0xaa4c98508c498fce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.892516:0:7778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da95f6ae/0xaa4c98508c498fce lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.892523:0:7778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da95f6ae/0xaa4c98508c498fce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.892530:0:7778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5200 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179135.892535:0:7778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da95f6ae/0xaa4c98508c498fce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.892543:0:7778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da95f6ae/0xaa4c98508c498fce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.892563:0:7778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da95f6ae/0xaa4c98508c498fce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.892570:0:7778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da95f6ae/0xaa4c98508c498fce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179135.892620:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2357:x1875041451026688:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 Request processed in 2831us (2960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179135.892626:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00100000:2.0:1788179135.895465:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179135.895514:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451027072 00000100:00100000:0.0:1788179135.895522:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451027072 00000100:00100000:0.0:1788179135.895562:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 83 00000100:00100000:0.0:1788179135.895569:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b68ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+12:10413:x1875041451027072:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788179135.895630:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498fd5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.895642:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498fd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.895648:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498fd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.896013:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498fdc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.896022:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c498f96 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466206c expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.896036:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498fdc lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.896062:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c498f96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466206c expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.896071:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c498f96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466206c expref: 13 pid: 5796 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179135.896081:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1875041472021248:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788179135.896175:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9359ea780 going to sleep for 11 seconds 00000100:00100000:0.0:1788179135.897943:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1875041472021248:192.168.202.2@tcp:104: 00000100:00100000:1.0:1788179135.897945:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00010000:00010000:0.0:1788179135.897965:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498fdc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179135.898213:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451027200 00000100:00100000:2.0:1788179135.898221:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451027200 00010000:00010000:2.0:1788179135.898263:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c498f96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466206c expref: 14 pid: 5796 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179135.898297:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00100000:2.0:1788179135.898303:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+14:2357:x1875041451027200:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788179135.898314:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179135.898318:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c498f96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466206c expref: 14 pid: 5796 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.898326:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c498f96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466206c expref: 14 pid: 5796 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.898340:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c498f96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466206c expref: 14 pid: 5796 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.898350:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bc903312100) 00010000:00010000:2.0:1788179135.898363:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498fdc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.898369:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498fdc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.898374:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498fdc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.898499:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788179135.898553:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+13:2357:x1875041451027200:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 249us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179135.898561:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 45 00010000:00010000:0.0:1788179135.903243:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498fdc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.903261:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498fdc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788179135.903471:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1788179135.903627:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1788179135.903675:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1788179135.903766:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5797:1875041472021376:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788179135.903831:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179135.903890:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9359eacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788179135.904135:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472021376 00000100:00100000:2.0:1788179135.904144:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472021376 00000100:00100000:2.0:1788179135.904185:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788179135.904194:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5797:x1875041472021376:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788179135.904290:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5797:x1875041472021376:12345-0@lo:1000:mdt00_001.0 Request processed in 95us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179135.904298:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788179135.904412:0:5797:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1788179135.904417:0:5797:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bc935a36a00, transno 4294967303 00000100:00100000:0.0:1788179135.904442:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5797:1875041472021376:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788179135.905047:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1788179135.905105:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5797:1875041472021504:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788179135.905158:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179135.905181:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93213b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788179135.905199:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472021504 00000100:00100000:0.0:1788179135.905204:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472021504 00000100:00100000:0.0:1788179135.905227:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788179135.905601:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5797:x1875041472021504:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788179135.905759:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5797:x1875041472021504:12345-0@lo:1000:mdt00_001.0 Request processed in 161us (601us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788179135.905768:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788179135.905802:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5797:1875041472021504:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788179135.905931:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498fdc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.905942:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498fdc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.905951:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498fdc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.905958:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179135.905963:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498fdc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.905971:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498fdc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.905986:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bc903312100) 00010000:00010000:1.0:1788179135.905990:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788179135.905994:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498fdc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.906001:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498fdc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.906097:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498f0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.906105:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498f0a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.906111:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498f0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.906127:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317fc00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179135.906130:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498f0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.906137:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498f0a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.906146:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cbf00) 00010000:00010000:1.0:1788179135.906149:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788179135.906152:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498f0a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.906158:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c498f0a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.906180:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c498fe3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.906194:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498f26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662050 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.906203:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c498fe3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.906229:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498f26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662050 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.906766:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498f26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662050 expref: 16 pid: 5827 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179135.906791:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1875041472021632:192.168.202.2@tcp:104: 00000100:00100000:1.0:1788179135.907252:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc90578d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788179135.912389:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179135.912530:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1875041472021632:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788179135.912566:0:11517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451027328 00010000:00010000:0.0:1788179135.912575:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c498fe3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179135.912576:0:11517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451027328 00010000:00010000:3.0:1788179135.912618:0:11517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498f26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662050 expref: 17 pid: 5827 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179135.912666:0:11517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:3.0:1788179135.912675:0:11517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+17:2356:x1875041451027328:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788179135.912690:0:11517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179135.912698:0:11517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498f26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662050 expref: 17 pid: 5827 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.912711:0:11517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498f26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662050 expref: 17 pid: 5827 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.912736:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498f26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662050 expref: 17 pid: 5827 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.912751:0:11517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cbf00) 00010000:00010000:3.0:1788179135.912757:0:11517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c498fe3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.912767:0:11517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c498fe3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.912776:0:11517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c498fe3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.913925:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c498fe3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.913938:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c498fe3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.913952:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c498fe3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.913960:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c498fe3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.913981:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c498fe3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.913988:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92e12dc00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179135.913994:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c498fe3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.914002:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c498fe3 lrc: 5/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.914015:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cbf00) 00010000:00010000:0.0:1788179135.914018:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179135.914022:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c498fe3 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.914147:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498fd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.914156:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498fd5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.914163:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498fd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.914169:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f400 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179135.914174:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498fd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.914181:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498fd5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.914201:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cbf00) 00010000:00010000:0.0:1788179135.914204:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788179135.914207:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498fd5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179135.914213:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c498fd5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.915416:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c498fe3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179135.915475:0:11517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179135.915547:0:11517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+16:2356:x1875041451027328:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 2870us (3176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179135.915554:0:11517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:0.0:1788179135.917362:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b68ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+15:10413:x1875041451027072:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 21783us (21894us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1788179135.917384:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 83 00000020:00080000:0.0:1788179135.917390:0:5797:0:(tgt_main.c:811:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788179135.917648:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788179135.917652:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788179135.917677:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788179135.917683:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788179135.920169:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179135.920245:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451027584 00000100:00100000:0.0:1788179135.920255:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451027584 00000100:00100000:0.0:1788179135.920308:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:0.0:1788179135.920318:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+15:10413:x1875041451027584:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788179135.924387:0:5800:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788179135.924531:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1788179135.924603:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c498fea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.924619:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c498fea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.924631:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c498fea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.924639:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c498fea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.924645:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c498fea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.924652:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c498fea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179135.925351:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788179135.925466:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+17:10413:x1875041451027584:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 5145us (5300us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788179135.925477:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00000020:00080000:1.0:1788179135.925484:0:5800:0:(tgt_main.c:811:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788179135.925504:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788179135.925514:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c498fea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.925524:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92e12d000 already unused, calling callback (ffffffffc1644220) 00010000:00010000:2.0:1788179135.925530:0:6606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c498fea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.925609:0:6606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c498fea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.925635:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9bc903340500) 00010000:00010000:2.0:1788179135.925638:0:6606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788179135.925642:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c498fea lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.925648:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c498fea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179135.925668:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179135.925670:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179135.925671:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179136.192210:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788179136.192234:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b68d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472021760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788179136.192313:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179136.192426:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472021760 00000100:00100000:2.0:1788179136.192434:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472021760 00000100:00100000:2.0:1788179136.192485:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788179136.192493:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875041472021760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788179136.192513:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1788179136.192571:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875041472021760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179136.192578:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788179136.192706:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b68d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472021760:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788179136.768099:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788179136.962564:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788179136.962574:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788179136.962633:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788179136.962640:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788179137.220632:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b68df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875041472022144:0@lo:400:kworker.0 00000100:00100000:2.0:1788179137.220699:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179137.220746:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788179137.220751:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b68fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472022272:0@lo:400:kworker.0 00000100:00100000:2.0:1788179137.220769:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179137.220939:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b68f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875041472022016:0@lo:400:kworker.0 00000100:00100000:3.0:1788179137.220966:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179137.220981:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b68d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472022528:0@lo:400:kworker.0 00000100:00100000:3.0:1788179137.220998:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179137.221010:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788179137.221014:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b68c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041472021888:0@lo:400:kworker.0 00000100:00100000:3.0:1788179137.221053:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179137.221096:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472022144 00000100:00100000:2.0:1788179137.221103:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472022144 00000100:00100000:1.0:1788179137.221171:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472022272 00000100:00100000:1.0:1788179137.221175:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472022272 00000100:00100000:1.0:1788179137.221205:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472022528 00000100:00100000:1.0:1788179137.221207:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472022528 00000100:00100000:1.0:1788179137.221225:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788179137.221233:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b68ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875041472022272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179137.221280:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b68ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875041472022272:12345-0@lo:400:kworker.0 Request processed in 47us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179137.221286:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788179137.221300:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788179137.221305:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1875041472022528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179137.221324:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1875041472022528:12345-0@lo:400:kworker.0 Request processed in 19us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179137.221329:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788179137.221359:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472021888 00000100:00100000:1.0:1788179137.221362:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472021888 00000100:00100000:1.0:1788179137.221381:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788179137.221386:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:3306:x1875041472021888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179137.221408:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:3306:x1875041472021888:12345-0@lo:400:kworker.0 Request processed in 23us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179137.221414:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788179137.221654:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b68c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041472021888:0@lo:400:kworker.0 00000100:00100000:3.0:1788179137.221662:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b68f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875041472022400:0@lo:400:kworker.0 00000100:00100000:3.0:1788179137.221683:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179137.221712:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b68d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472022528:0@lo:400:kworker.0 00000100:00100000:0.0:1788179137.222968:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472022016 00000100:00100000:0.0:1788179137.222975:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472022016 00000100:00100000:2.0:1788179137.224182:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472022400 00000100:00100000:2.0:1788179137.224191:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472022400 00000100:00100000:0.0:1788179137.224655:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788179137.224666:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b68d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875041472022144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179137.224741:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b68d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875041472022144:12345-0@lo:400:kworker.0 Request processed in 78us (4041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179137.224748:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788179137.224770:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788179137.224775:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875041472022016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179137.225188:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788179137.225197:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875041472022400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179137.225246:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b68fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472022272:0@lo:400:kworker.0 00000100:00100000:3.0:1788179137.225258:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b68df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875041472022144:0@lo:400:kworker.0 00000100:00080000:3.0:1788179137.225288:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788179137.225292:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788179137.225295:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788179137.225377:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875041472022016:12345-0@lo:400:kworker.0 Request processed in 600us (4409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179137.225384:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788179137.225453:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b68f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875041472022016:0@lo:400:kworker.0 00000100:00100000:2.0:1788179137.225532:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875041472022400:12345-0@lo:400:kworker.0 Request processed in 336us (3846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179137.225540:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788179137.231036:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b68f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875041472022400:0@lo:400:kworker.0 00000040:00080000:2.0:1788179137.553269:0:11902:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788179137.553280:0:11902:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788179137.553317:0:11902:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788179137.553323:0:11902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788179137.689485:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179137.689635:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451027840 00000100:00100000:0.0:1788179137.689645:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451027840 00000100:00080000:3.0:1788179137.689712:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788179137.689772:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 84 00000100:00100000:0.0:1788179137.689783:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+17:10432:x1875041451027840:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788179137.689808:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179137.689828:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498ff1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662088 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179137.690161:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498ff8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179137.690177:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498ff8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179137.690190:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498ff8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179137.690202:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1788179137.690396:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c498ff1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662088 expref: 20 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179137.690416:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498ff8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662088 expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179137.690450:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:0.0:1788179137.690453:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788179137.690457:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317e400, rc 0) 00000100:00100000:0.0:1788179137.690516:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+19:10432:x1875041451027840:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 735us (1042us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1788179137.690523:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 84 00000100:00100000:3.0:1788179137.693714:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179137.693812:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451027968 00000100:00100000:2.0:1788179137.693821:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451027968 00000100:00100000:2.0:1788179137.693979:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 85 00000100:00100000:2.0:1788179137.693990:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+19:10432:x1875041451027968:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:2.0:1788179137.694157:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499006 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694174:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499006 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694186:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499006 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694201:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49900d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694207:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49900d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694212:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49900d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694520:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499014 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694528:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694536:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788179137.694574:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694587:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499006 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694593:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499006 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694600:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499006 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694607:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c4600 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179137.694611:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499006 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694618:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499006 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694629:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:2.0:1788179137.694632:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179137.694637:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499006 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694649:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499006 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694661:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49900d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694666:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49900d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694672:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49900d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694676:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5e00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179137.694679:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49900d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694686:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49900d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694693:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bc909481d00) 00010000:00010000:2.0:1788179137.694695:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179137.694698:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49900d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694704:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49900d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694727:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694733:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499014 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694744:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694749:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c4a00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179137.694752:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694757:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499014 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694764:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc909481000) 00010000:00010000:2.0:1788179137.694766:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179137.694769:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499014 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.694774:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499014 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179137.694935:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+19:10432:x1875041451027968:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 944us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179137.694943:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 85 00000100:00100000:1.0:1788179137.728231:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788179137.728270:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b68c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472022656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788179137.728354:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179137.728508:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472022656 00000100:00100000:2.0:1788179137.728517:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472022656 00000100:00100000:2.0:1788179137.728566:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788179137.728576:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875041472022656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788179137.728612:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179137.728659:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875041472022656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179137.728666:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788179137.728732:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b68c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472022656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788179137.751389:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179137.751477:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451028224 00000100:00100000:2.0:1788179137.751488:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451028224 00000100:00100000:2.0:1788179137.751547:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 86 00000100:00100000:2.0:1788179137.751557:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+19:10435:x1875041451028224:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788179137.751578:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179137.751599:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49901b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466208f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.751668:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c499022 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.751682:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c499022 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.751692:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c499022 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.751706:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499029 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.751713:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.751719:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.752127:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499030 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.752137:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.752150:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179137.752161:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788179137.752254:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c499022 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.752262:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c499022 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.752269:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c499022 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.752275:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5e00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179137.752279:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c499022 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.752287:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c499022 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.752299:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:2.0:1788179137.752302:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179137.752306:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c499022 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.752312:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c499022 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.752321:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.752328:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499029 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.752339:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499029 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.752345:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c4600 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179137.752348:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499029 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.752354:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499029 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.752361:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bc909481000) 00010000:00010000:2.0:1788179137.752364:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179137.752366:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499029 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.752372:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499029 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.752421:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49901b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466208f expref: 22 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.752435:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499030 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466208f expref: 21 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.752443:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc909481d00) 00010000:00010000:2.0:1788179137.752445:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788179137.752447:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c5600, rc 0) 00000100:00100000:2.0:1788179137.752503:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+21:10435:x1875041451028224:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 948us (1124us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1788179137.752519:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 86 00000100:00100000:3.0:1788179137.756051:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179137.756242:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451028352 00000100:00100000:2.0:1788179137.756251:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451028352 00000100:00100000:2.0:1788179137.756337:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 87 00000100:00100000:2.0:1788179137.756347:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f87ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+21:10435:x1875041451028352:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:2.0:1788179137.756405:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c49903e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.756421:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c49903e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.756431:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c49903e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.756456:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c49903e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.756464:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c49903e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.756471:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c49903e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.756476:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179137.756481:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c49903e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.756489:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c49903e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.756499:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc909481d00) 00010000:00010000:2.0:1788179137.756508:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788179137.756513:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c49903e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.756520:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c49903e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179137.756585:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f87ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+21:10435:x1875041451028352:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 239us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179137.756592:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 87 00000100:00100000:3.0:1788179137.762338:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179137.762415:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451028608 00000100:00100000:0.0:1788179137.762425:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451028608 00000100:00100000:0.0:1788179137.762483:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:0.0:1788179137.762492:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9266fd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+21:10435:x1875041451028608:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:0.0:1788179137.762716:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9266fd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+22:10435:x1875041451028608:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 224us (388us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1788179137.762724:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 21 00010000:00010000:1.0:1788179137.795578:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179137.815315:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179137.815388:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451028864 00000100:00100000:2.0:1788179137.815397:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451028864 00000100:00100000:2.0:1788179137.815511:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 88 00000100:00100000:2.0:1788179137.815522:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+22:9955:x1875041451028864:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1788179137.815547:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179137.815570:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499045 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662096 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.815669:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49904c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.815684:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499030 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466208f expref: 23 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.815694:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49904c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.815727:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499030 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466208f expref: 23 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.815759:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499030 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466208f expref: 23 pid: 5827 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179137.815773:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b68c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5827:1875041472022784:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788179137.815935:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc803c6f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788179137.817666:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b68c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5827:1875041472022784:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788179137.817694:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49904c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179137.818409:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179137.818514:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451028992 00000100:00100000:2.0:1788179137.818523:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451028992 00010000:00010000:2.0:1788179137.818561:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499030 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466208f expref: 24 pid: 5827 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179137.818602:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:2.0:1788179137.818610:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f878000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+24:2357:x1875041451028992:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788179137.818623:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179137.818629:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499030 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466208f expref: 24 pid: 5827 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.818640:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499030 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466208f expref: 24 pid: 5827 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.818660:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499030 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466208f expref: 24 pid: 5827 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.818690:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc909481d00) 00010000:00010000:2.0:1788179137.818694:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49904c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.818703:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49904c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.818711:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49904c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.818739:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788179137.818789:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f878000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+23:2357:x1875041451028992:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 179us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179137.818797:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 47 00010000:00010000:0.0:1788179137.819060:0:5827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49904c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179137.819069:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49904c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179137.819085:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788179137.819306:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499045 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662096 expref: 24 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179137.819324:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49904c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662096 expref: 23 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179137.819344:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc909481d00) 00010000:00010000:0.0:1788179137.819347:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788179137.819349:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c4a00, rc 0) 00000100:00100000:0.0:1788179137.819437:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+23:9955:x1875041451028864:12345-192.168.202.2@tcp:101:bash.0 Request processed in 3917us (4133us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788179137.819444:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 88 00000100:00100000:0.0:1788179137.824563:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179137.824642:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451029248 00000100:00100000:1.0:1788179137.824652:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451029248 00000100:00100000:1.0:1788179137.824712:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 89 00000100:00100000:1.0:1788179137.824722:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+23:9955:x1875041451029248:12345-192.168.202.2@tcp:36:bash.0 00010000:00010000:1.0:1788179137.825016:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c49905a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.825033:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c49905a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.825058:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c49905a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788179137.825106:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1788179137.825131:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006636db6e reply state 00000000d91125a0 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c49905a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179137.825141:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788179137.825186:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1788179137.825291:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+27:9955:x1875041451029248:12345-192.168.202.2@tcp:36:bash.0 Request processed in 570us (736us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1788179137.825299:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 89 00000020:00080000:1.0:1788179137.825303:0:5796:0:(tgt_main.c:811:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788179137.827069:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c49905a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179137.827084:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c49905a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179137.827092:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c49905a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179137.827098:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92e12de00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179137.827102:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c49905a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179137.827110:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c49905a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179137.827136:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc909481d00) 00010000:00010000:3.0:1788179137.827139:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179137.827144:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c49905a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179137.827151:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c49905a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179137.828602:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179137.828687:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451029376 00000100:00100000:1.0:1788179137.828697:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451029376 00000100:00100000:1.0:1788179137.828777:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 90 00000100:00100000:1.0:1788179137.828787:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f87aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+26:9955:x1875041451029376:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:1.0:1788179137.828808:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179137.828825:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c499061 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466209d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.828934:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c499061 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466209d expref: 27 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.828947:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c499061 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466209d expref: 27 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.828964:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc909481d00) 00010000:00010000:1.0:1788179137.828967:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788179137.828971:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc92e12d000, rc 0) 00000100:00100000:1.0:1788179137.829017:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f87aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+27:9955:x1875041451029376:12345-192.168.202.2@tcp:101:bash.0 Request processed in 232us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179137.829024:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 90 00000100:00100000:0.0:1788179137.831339:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179137.831399:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451029504 00000100:00100000:2.0:1788179137.831408:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451029504 00000100:00100000:2.0:1788179137.831472:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:2.0:1788179137.831481:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a4a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:9955:x1875041451029504:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1788179137.831496:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179137.831516:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052bc5d45/0xaa4c98508c499068 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746620a4 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788179137.831541:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9572bd, atime: 0x6a9572bc, ctime: 0x6a9572bd, blocks: 0xb 00010000:00010000:2.0:1788179137.831560:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=333s v=(0 0) 00010000:00010000:2.0:1788179137.831564:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179137.831571:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052bc5d45/0xaa4c98508c499068 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620a4 expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.831607:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000052bc5d45/0xaa4c98508c499068 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620a4 expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.831619:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c4600, rc 0) 00000100:00100000:2.0:1788179137.831665:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a4a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:9955:x1875041451029504:12345-192.168.202.2@tcp:101:bash.0 Request processed in 184us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179137.831671:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00080000:3.0:1788179137.831892:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788179137.834005:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179137.834261:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451029632 00000100:00100000:1.0:1788179137.834271:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451029632 00002000:00010000:1.0:1788179137.834311:0:6595:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1788179137.834316:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bc93f87a680 with x1875041451029632 ext(0->18446744073709551615) 00002000:00010000:1.0:1788179137.834327:0:6595:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bc93f87a680. 00000100:00100000:1.0:1788179137.834359:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:1.0:1788179137.834369:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f87a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2356:x1875041451029632:12345-192.168.202.2@tcp:10:bash.0 00002000:00010000:1.0:1788179137.834643:0:6595:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788179137.834647:0:6595:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788179133 -> 1788179137 00002000:00010000:1.0:1788179137.834649:0:6595:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788179132 -> 1788179132 00002000:00010000:1.0:1788179137.834651:0:6595:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788179133 -> 1788179137 00002000:00010000:1.0:1788179137.834654:0:6595:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788179137.834747:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f87a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2356:x1875041451029632:12345-192.168.202.2@tcp:10:bash.0 Request processed in 378us (750us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788179137.834768:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 1 00002000:00010000:1.0:1788179137.834772:0:6595:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1788179137.834775:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bc93f87a680 with x1875041451029632 ext(0->18446744073709551615) 00002000:00010000:1.0:1788179137.834780:0:6595:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bc93f87a680. 00000100:00100000:3.0:1788179137.936018:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179137.936247:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451029760 00000100:00100000:1.0:1788179137.936259:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451029760 00000100:00100000:1.0:1788179137.936324:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 91 00000100:00100000:1.0:1788179137.936333:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+27:10449:x1875041451029760:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:1.0:1788179137.936404:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c49906f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.936420:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c49906f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.936447:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c49906f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.936462:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c499076 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.936470:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c499076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.936476:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c499076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.937109:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c49907d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.937120:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c49907d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.937136:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c49907d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788179137.937178:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c49907d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.937189:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c49906f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.937196:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c49906f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.937203:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c49906f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.937315:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92e12dc00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179137.937320:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c49906f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.937328:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c49906f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.937339:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:1.0:1788179137.937342:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179137.937346:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c49906f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.937352:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c49906f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.937365:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c499076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.937376:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c499076 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.937382:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c499076 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.937386:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92e12d600 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179137.937389:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c499076 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.937394:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c499076 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.937401:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bc903340e00) 00010000:00010000:1.0:1788179137.937403:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179137.937405:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c499076 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.937411:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c499076 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.937435:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c49907d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.937441:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c49907d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.937447:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c49907d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.937451:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92e12c400 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179137.937459:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c49907d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.937465:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c49907d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.937473:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc909481d00) 00010000:00010000:1.0:1788179137.937476:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179137.937479:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c49907d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179137.937484:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c49907d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179137.942632:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+27:10449:x1875041451029760:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 6288us (6622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179137.942646:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 91 00000100:00100000:0.0:1788179137.988556:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179137.988664:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451030016 00000100:00100000:2.0:1788179137.988675:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451030016 00000100:00100000:2.0:1788179137.988740:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 92 00000100:00100000:2.0:1788179137.988750:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+27:10452:x1875041451030016:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788179137.988769:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179137.988800:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499084 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746620ab expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.988926:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49908b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.988942:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49908b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.988954:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49908b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.988969:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499092 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.989008:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.989016:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.989349:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499099 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.989360:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.989368:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179137.989378:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788179137.989463:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49908b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.989471:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49908b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.989478:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49908b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.989483:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5e00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179137.989487:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49908b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.989493:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49908b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.989515:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:2.0:1788179137.989518:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179137.989522:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49908b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.989529:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49908b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.989541:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.989547:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499092 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.989552:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499092 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.989557:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c4000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179137.989560:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499092 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.989566:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499092 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.989572:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bc909481a00) 00010000:00010000:2.0:1788179137.989574:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179137.989577:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499092 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.989583:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499092 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.989639:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499084 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620ab expref: 30 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.989653:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499099 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620ab expref: 29 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179137.989660:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc909481d00) 00010000:00010000:2.0:1788179137.989662:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788179137.989664:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c5000, rc 0) 00000100:00100000:2.0:1788179137.989728:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+29:10452:x1875041451030016:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 980us (1181us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1788179137.989736:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 92 00000100:00100000:3.0:1788179137.992600:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179137.993692:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451030144 00000100:00100000:0.0:1788179137.993704:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451030144 00000100:00100000:0.0:1788179137.993803:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 93 00000100:00100000:0.0:1788179137.993813:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f87b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+29:10452:x1875041451030144:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:0.0:1788179137.993914:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179137.993941:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49904c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662096 expref: 29 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179137.993952:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990a7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179137.993986:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49904c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662096 expref: 29 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179137.994225:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49904c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662096 expref: 29 pid: 5827 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179137.994240:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93a82f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1875041472022912:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788179137.994671:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc91322d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788179137.997243:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93a82f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1875041472022912:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788179137.997272:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179137.997658:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179137.997730:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451030400 00000100:00100000:0.0:1788179137.997736:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451030400 00000100:00100000:0.0:1788179137.997786:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:0.0:1788179137.997801:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f87a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+30:5570:x1875041451030400:12345-192.168.202.2@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788179137.998494:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f87a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+31:5570:x1875041451030400:12345-192.168.202.2@tcp:35:ldlm_bl.0 Request processed in 691us (833us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788179137.998503:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:0.0:1788179138.013501:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179138.013624:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451030528 00000100:00100000:1.0:1788179138.013634:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451030528 00010000:00010000:1.0:1788179138.013676:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49904c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662096 expref: 31 pid: 5827 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179138.013758:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:1.0:1788179138.013768:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+31:2356:x1875041451030528:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788179138.013796:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788179138.013803:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49904c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662096 expref: 31 pid: 5827 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.013816:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49904c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662096 expref: 31 pid: 5827 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.013873:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49904c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662096 expref: 31 pid: 5827 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.013922:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc909481d00) 00010000:00010000:1.0:1788179138.013928:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.013937:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.013945:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990a7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.013968:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788179138.014186:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.014195:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.014236:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.014254:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.014260:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.014266:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179138.014270:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.014276:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.014286:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc909481d00) 00010000:00010000:0.0:1788179138.014288:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788179138.014292:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.014298:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179138.014382:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+30:2356:x1875041451030528:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 613us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179138.014390:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:0.0:1788179138.016049:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f87b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+29:10452:x1875041451030144:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 22229us (23449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179138.016062:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 93 00000100:00100000:1.0:1788179138.027683:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179138.027824:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451030784 00000100:00100000:3.0:1788179138.027842:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451030784 00000100:00100000:3.0:1788179138.027930:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:3.0:1788179138.027940:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+29:10452:x1875041451030784:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:3.0:1788179138.028302:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+30:10452:x1875041451030784:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 362us (629us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788179138.028311:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:2.0:1788179138.159317:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179138.159432:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451031040 00000100:00100000:0.0:1788179138.159442:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451031040 00000100:00100000:0.0:1788179138.159506:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 94 00000100:00100000:0.0:1788179138.159516:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b68dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+30:10463:x1875041451031040:12345-192.168.202.2@tcp:101:cat.0 00010000:00010000:0.0:1788179138.159540:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179138.159575:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4990ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746620b2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.159669:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990b5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.159684:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.159707:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.159732:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.159740:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.159746:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.160152:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4990c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.160163:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4990c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.160173:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4990c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179138.160183:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788179138.160275:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.160293:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990b5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.160300:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.160307:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317e200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179138.160311:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.160319:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.160331:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:0.0:1788179138.160333:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179138.160338:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.160344:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.160356:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.160361:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.160366:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.160370:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179138.160379:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.160385:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.160392:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bc9062cb100) 00010000:00010000:0.0:1788179138.160394:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179138.160397:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.160403:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.160444:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4990ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620b2 expref: 33 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.160457:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4990c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620b2 expref: 32 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.160463:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc909481d00) 00010000:00010000:0.0:1788179138.160466:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788179138.160468:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317ee00, rc 0) 00000100:00100000:0.0:1788179138.160529:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b68dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+32:10463:x1875041451031040:12345-192.168.202.2@tcp:101:cat.0 Request processed in 1015us (1224us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788179138.160537:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 94 00000100:00100000:0.0:1788179138.172132:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179138.172341:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451031296 00000100:00100000:3.0:1788179138.172351:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451031296 00000100:00100000:3.0:1788179138.172417:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:3.0:1788179138.172428:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+32:10463:x1875041451031296:12345-192.168.202.2@tcp:35:cat.0 00000100:00100000:3.0:1788179138.172991:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+33:10463:x1875041451031296:12345-192.168.202.2@tcp:35:cat.0 Request processed in 562us (875us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788179138.173016:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:2.0:1788179138.192981:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179138.193079:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451031552 00000100:00100000:0.0:1788179138.193090:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451031552 00000100:00100000:0.0:1788179138.193150:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 95 00000100:00100000:0.0:1788179138.193173:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b68ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+33:10464:x1875041451031552:12345-192.168.202.2@tcp:36:rm.0 00010000:00010000:0.0:1788179138.193240:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788179138.193267:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4990c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620b2 expref: 33 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.193291:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499099 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620ab expref: 32 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.193305:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c499061 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466209d expref: 31 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.193315:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc909481d00) 00010000:00010000:0.0:1788179138.193336:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788179138.193357:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4990d1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.193371:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4990d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.193381:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4990d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.193396:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.193402:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.193408:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.193823:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990df lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.193833:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.193840:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788179138.194564:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1788179138.194574:0:5796:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 334257724195ns, next at 335257722063ns, rc = 0 00010000:00010000:0.0:1788179138.194635:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4990e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.194647:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4990e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.194655:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4990e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.194663:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4990e6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.194669:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4990e6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.194675:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4990e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.197281:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788179138.197326:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.197348:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990df lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.197355:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990df lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.197360:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317e200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179138.197365:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990df lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.197372:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990df lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.197387:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cbb00) 00010000:00010000:0.0:1788179138.197391:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788179138.197395:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990df lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.197401:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990df lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.197422:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4990d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.197427:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4990d1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.197433:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4990d1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.197437:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317fa00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179138.197448:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4990d1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.197453:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4990d1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.197461:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:0.0:1788179138.197464:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179138.197466:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4990d1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.197472:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4990d1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788179138.197481:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000012bbcbbc reply state 00000000614be87a transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179138.197489:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788179138.197585:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b68ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+32:10464:x1875041451031552:12345-192.168.202.2@tcp:36:rm.0 Request processed in 4410us (4611us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788179138.197595:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 95 00010000:00010000:3.0:1788179138.200071:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.200090:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.200098:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.200104:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179138.200109:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.200116:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.200132:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bc9062cb100) 00010000:00010000:3.0:1788179138.200136:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179138.200140:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.200147:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4990d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.208216:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788179138.208233:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4990e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.208244:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f000 already unused, calling callback (ffffffffc1644220) 00010000:00010000:1.0:1788179138.208249:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4990e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.208259:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4990e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.208279:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9bc9062cbb00) 00010000:00010000:1.0:1788179138.208282:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788179138.208287:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4990e6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.208315:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4990e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.208347:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179138.208349:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179138.208351:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788179138.239191:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179138.239288:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451031808 00000100:00100000:0.0:1788179138.239298:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451031808 00000100:00100000:0.0:1788179138.239367:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 96 00000100:00100000:0.0:1788179138.239378:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b68c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+31:10470:x1875041451031808:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1788179138.239403:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179138.239426:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4990ed lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746620b9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.239599:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990f4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.239621:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.239632:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.239647:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4990fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.239655:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4990fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.239661:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4990fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788179138.240590:0:5827:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788179138.241215:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499102 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.241231:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.241242:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.241293:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.241313:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990f4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.241320:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.241327:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317e200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179138.241331:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.241339:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990f4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.241351:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:2.0:1788179138.241354:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179138.241359:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990f4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.241365:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4990f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788179138.241376:0:5827:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000424957c reply state 00000000a81589f0 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4990fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179138.241385:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788179138.241416:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4990ed lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620b9 expref: 34 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.241430:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499102 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620b9 expref: 33 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.241450:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc909481a00) 00010000:00010000:2.0:1788179138.241452:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788179138.241455:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c5000, rc 0) 00000100:00100000:2.0:1788179138.241535:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b68c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+34:10470:x1875041451031808:12345-192.168.202.2@tcp:101:bash.0 Request processed in 2159us (2354us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788179138.241544:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 96 00000100:00100000:3.0:1788179138.258328:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00010000:00010000:3.0:1788179138.258360:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4990fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.258373:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4990fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.258393:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4990fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.258400:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317ee00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179138.258405:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4990fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.258414:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4990fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.258429:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bc9062cbc00) 00010000:00010000:3.0:1788179138.258432:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179138.258437:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4990fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.258444:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4990fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179138.258481:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451031936 00000100:00100000:3.0:1788179138.258489:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451031936 00000100:00100000:3.0:1788179138.258543:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:3.0:1788179138.258552:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2354:x1875041451031936:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:3.0:1788179138.258569:0:7778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179138.258586:0:7778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f8d7c41/0xaa4c98508c499110 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746620c0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788179138.258609:0:7778:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788179138.258626:0:7778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=334s v=(0 0) 00010000:00010000:3.0:1788179138.258635:0:7778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788179138.258644:0:7778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f8d7c41/0xaa4c98508c499110 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620c0 expref: 6 pid: 7778 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.258662:0:7778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007f8d7c41/0xaa4c98508c499110 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620c0 expref: 6 pid: 7778 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.258673:0:7778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b5000, rc 0) 00000100:00100000:3.0:1788179138.258725:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2354:x1875041451031936:12345-192.168.202.2@tcp:101:bash.0 Request processed in 173us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179138.258732:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00080000:3.0:1788179138.258752:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788179138.278119:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179138.283317:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451032064 00000100:00100000:1.0:1788179138.283334:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451032064 00000100:00100000:1.0:1788179138.283391:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:1.0:1788179138.283402:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b68c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:10470:x1875041451032064:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:1.0:1788179138.283420:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179138.283438:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cfe242b/0xaa4c98508c499117 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746620c7 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.283472:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007f8d7c41/0xaa4c98508c499110 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620c0 expref: 7 pid: 7778 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.283481:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179138.283485:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179138.283491:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cfe242b/0xaa4c98508c499117 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620c7 expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.283524:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007f8d7c41/0xaa4c98508c499110 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620c0 expref: 7 pid: 7778 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.283538:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007f8d7c41/0xaa4c98508c499110 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620c0 expref: 7 pid: 7778 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179138.283568:0:6589:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a37480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6589:1875041472023040:192.168.202.2@tcp:104: 00000100:00100000:1.0:1788179138.283672:0:6589:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9265d0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788179138.287256:0:6589:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a37480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6589:1875041472023040:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788179138.287270:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00010000:00010000:1.0:1788179138.287301:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005cfe242b/0xaa4c98508c499117 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620c7 expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.287324:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc92e12dc00, rc 0) 00000100:00100000:2.0:1788179138.287512:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451032192 00000100:00100000:2.0:1788179138.287520:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451032192 00010000:00010000:2.0:1788179138.287553:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007f8d7c41/0xaa4c98508c499110 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620c0 expref: 8 pid: 7778 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179138.287590:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:2.0:1788179138.287600:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90710f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2356:x1875041451032192:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788179138.287614:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179138.287635:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007f8d7c41/0xaa4c98508c499110 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620c0 expref: 8 pid: 7778 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.287648:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007f8d7c41/0xaa4c98508c499110 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620c0 expref: 8 pid: 7778 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.287670:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f8d7c41/0xaa4c98508c499110 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620c0 expref: 8 pid: 7778 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.287704:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179138.287709:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179138.287716:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005cfe242b/0xaa4c98508c499117 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620c7 expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.287740:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cfe242b/0xaa4c98508c499117 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620c7 expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.287775:0:5783:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005cfe242b/0xaa4c98508c499117 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620c7 expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179138.287790:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b68ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5783:1875041472023168:192.168.202.2@tcp:105: 00000100:00100000:1.0:1788179138.287902:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b68c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:10470:x1875041451032064:12345-192.168.202.2@tcp:101:bash.0 Request processed in 4500us (9790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179138.287911:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:2.0:1788179138.288216:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc803c6fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788179138.298194:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179138.298515:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451032448 00000100:00100000:0.0:1788179138.298525:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451032448 00000100:00100000:0.0:1788179138.298573:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:0.0:1788179138.298582:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+33:10470:x1875041451032448:12345-192.168.202.2@tcp:35:bash.0 00000100:00100000:0.0:1788179138.298960:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+34:10470:x1875041451032448:12345-192.168.202.2@tcp:35:bash.0 Request processed in 377us (774us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788179138.298968:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:3.0:1788179138.300473:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b68ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5783:1875041472023168:192.168.202.2@tcp:105: 00010000:00010000:3.0:1788179138.300497:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179138.300749:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90710f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2356:x1875041451032192:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 13149us (13482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179138.300760:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 49 00000001:00080000:2.0:1788179138.334408:0:7496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:1.0:1788179138.463322:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179138.463527:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451032576 00000100:00100000:2.0:1788179138.463538:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451032576 00000100:00100000:2.0:1788179138.463582:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 97 00000100:00100000:2.0:1788179138.463600:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+34:10486:x1875041451032576:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788179138.463621:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179138.463637:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49911e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746620ce expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.463689:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499125 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.463713:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.463722:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179138.463771:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1788179138.463774:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788179138.463790:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.463816:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49911e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620ce expref: 36 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.463835:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499125 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620ce expref: 35 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.463844:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:2.0:1788179138.463896:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788179138.463900:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c4000, rc 0) 00000100:00100000:2.0:1788179138.463958:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+35:10486:x1875041451032576:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 369us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179138.463965:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 97 00000100:00100000:2.0:1788179138.471637:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179138.472116:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451032832 00000100:00100000:1.0:1788179138.472126:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451032832 00000100:00100000:1.0:1788179138.472189:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 98 00000100:00100000:1.0:1788179138.472199:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b68e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+35:10486:x1875041451032832:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788179138.472225:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179138.472244:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c49912c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746620d5 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.472342:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c499133 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.472355:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c499133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.472382:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c499133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788179138.472393:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788179138.472525:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c49912c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620d5 expref: 38 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.472544:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c499133 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620d5 expref: 37 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.472553:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc909481a00) 00010000:00010000:1.0:1788179138.472556:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788179138.472559:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc92e12c400, rc 0) 00000100:00100000:1.0:1788179138.472624:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b68e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+37:10486:x1875041451032832:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 426us (996us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788179138.472631:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 98 00000100:00100000:1.0:1788179138.480106:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179138.480251:0:11517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451033088 00000100:00100000:3.0:1788179138.480261:0:11517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451033088 00000100:00100000:3.0:1788179138.480326:0:11517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:3.0:1788179138.480336:0:11517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+37:2357:x1875041451033088:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788179138.480353:0:11517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179138.480376:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c499133 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620d5 expref: 37 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.480412:0:11517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc909481a00) 00010000:00010000:3.0:1788179138.480417:0:11517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179138.480489:0:11517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+36:2357:x1875041451033088:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 154us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179138.480497:0:11517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:0.0:1788179138.481929:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179138.482307:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451033216 00000100:00100000:2.0:1788179138.482315:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451033216 00000100:00100000:2.0:1788179138.482367:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 99 00000100:00100000:2.0:1788179138.482377:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+36:10486:x1875041451033216:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788179138.482414:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179138.482438:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499141 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746620dc expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.482536:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499148 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.482550:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499148 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.482560:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499148 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179138.482572:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788179138.482692:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499141 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620dc expref: 39 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.482710:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499148 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620dc expref: 38 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.482718:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc909481a00) 00010000:00010000:2.0:1788179138.482721:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788179138.482724:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c5200, rc 0) 00000100:00100000:2.0:1788179138.482783:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+38:10486:x1875041451033216:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 407us (859us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788179138.482798:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 99 00000100:00100000:2.0:1788179138.492966:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179138.493095:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451033344 00000100:00100000:3.0:1788179138.493104:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451033344 00000100:00100000:3.0:1788179138.493206:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:3.0:1788179138.493217:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b68ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2356:x1875041451033344:12345-192.168.202.2@tcp:1:lfs.0 00010000:00010000:3.0:1788179138.493260:0:7778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036de7492/0xaa4c98508c499156 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.493282:0:7778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005cfe242b/0xaa4c98508c499117 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620c7 expref: 6 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.493292:0:7778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788179138.493296:0:7778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788179138.493301:0:7778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036de7492/0xaa4c98508c499156 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.493335:0:7778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005cfe242b/0xaa4c98508c499117 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620c7 expref: 6 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.493350:0:7778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005cfe242b/0xaa4c98508c499117 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620c7 expref: 6 pid: 6589 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179138.493384:0:7778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f878000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7778:1875041472023296:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788179138.493475:0:7778:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc902f9b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788179138.499059:0:7778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f878000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7778:1875041472023296:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788179138.499090:0:7778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000036de7492/0xaa4c98508c499156 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179138.499443:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179138.499516:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451033472 00000100:00100000:1.0:1788179138.499523:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451033472 00002000:00100000:1.0:1788179138.499567:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9bc93b68ea00 x1875041451033472/t0(0) o4->334bb25c-6762-4beb-8a84-3a838cbc7e80@192.168.202.2@tcp:154/0 lens 504/0 e 0 to 0 dl 1788179149 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788179138.499577:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bc93b68ea00 with x1875041451033472 ext(0->8) 00010000:00010000:1.0:1788179138.499585:0:6597:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005cfe242b/0xaa4c98508c499117 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620c7 expref: 7 pid: 6589 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.499599:0:6597:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005cfe242b/0xaa4c98508c499117 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620c7 expref: 7 pid: 6589 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788179138.499619:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bc93b68ea00 00000100:00100000:1.0:1788179138.499654:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:1.0:1788179138.499663:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b68ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2356:x1875041451033472:12345-192.168.202.2@tcp:4:lfs.0 00000100:00100000:1.0:1788179138.500184:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b68ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+9:2356:x1875041451033472:12345-192.168.202.2@tcp:4:lfs.0 Request processed in 519us (739us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788179138.500192:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 1 00002000:00100000:1.0:1788179138.500199:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9bc93b68ea00 x1875041451033472/t4294967302(0) o4->334bb25c-6762-4beb-8a84-3a838cbc7e80@192.168.202.2@tcp:154/0 lens 504/448 e 0 to 0 dl 1788179149 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788179138.500208:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bc93b68ea00 with x1875041451033472 ext(0->8) 00010000:00010000:1.0:1788179138.500215:0:6597:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005cfe242b/0xaa4c98508c499117 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620c7 expref: 9 pid: 6589 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.500228:0:6597:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005cfe242b/0xaa4c98508c499117 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620c7 expref: 9 pid: 6589 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788179138.500236:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bc93b68ea00 00000100:00100000:1.0:1788179138.503284:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179138.503424:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451033600 00000100:00100000:2.0:1788179138.503445:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451033600 00010000:00010000:2.0:1788179138.503553:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005cfe242b/0xaa4c98508c499117 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620c7 expref: 9 pid: 6589 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179138.503595:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 50 00000100:00100000:2.0:1788179138.503604:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+9:2354:x1875041451033600:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788179138.503620:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788179138.503638:0:5782:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788179138.503641:0:5782:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788179137 00002000:00010000:2.0:1788179138.503643:0:5782:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788179137 00002000:00010000:2.0:1788179138.503645:0:5782:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788179137 00010000:00010000:2.0:1788179138.503652:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005cfe242b/0xaa4c98508c499117 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620c7 expref: 9 pid: 6589 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.503664:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005cfe242b/0xaa4c98508c499117 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620c7 expref: 9 pid: 6589 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.503688:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cfe242b/0xaa4c98508c499117 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620c7 expref: 9 pid: 6589 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.503705:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788179138.503710:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788179138.503715:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000036de7492/0xaa4c98508c499156 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.503726:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036de7492/0xaa4c98508c499156 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.503822:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788179138.503918:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2354:x1875041451033600:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 315us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179138.503926:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 50 00010000:00010000:0.0:1788179138.505688:0:7778:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000036de7492/0xaa4c98508c499156 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.505707:0:7778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036de7492/0xaa4c98508c499156 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.505759:0:7778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036de7492/0xaa4c98508c499156 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.505768:0:7778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036de7492/0xaa4c98508c499156 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.505776:0:7778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036de7492/0xaa4c98508c499156 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.505838:0:7778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4200 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179138.505844:0:7778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036de7492/0xaa4c98508c499156 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.506285:0:7778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036de7492/0xaa4c98508c499156 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.506305:0:7778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036de7492/0xaa4c98508c499156 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.506313:0:7778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036de7492/0xaa4c98508c499156 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179138.506447:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b68ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2356:x1875041451033344:12345-192.168.202.2@tcp:1:lfs.0 Request processed in 13228us (13485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179138.506457:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:1.0:1788179138.524654:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179138.528705:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451033856 00000100:00100000:0.0:1788179138.528720:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451033856 00000100:00100000:0.0:1788179138.528925:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00100000:0.0:1788179138.528936:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9266ff050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+38:10486:x1875041451033856:12345-192.168.202.2@tcp:35:lfs.0 00000004:00010000:0.0:1788179138.529003:0:5799:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499148 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620dc expref: 38 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788179138.529306:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1788179138.529353:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1788179138.530082:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1788179138.530143:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49915d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.530259:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499102 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620b9 expref: 42 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.530271:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49915d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.530312:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499102 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620b9 expref: 42 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.530328:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499102 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620b9 expref: 42 pid: 5827 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179138.530343:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93a82f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5799:1875041472023424:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788179138.530419:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc918518e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788179138.536994:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179138.537105:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93a82f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5799:1875041472023424:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788179138.537134:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49915d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179138.537146:0:11517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451033984 00000100:00100000:3.0:1788179138.537154:0:11517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451033984 00010000:00010000:3.0:1788179138.537288:0:11517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499102 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620b9 expref: 43 pid: 5827 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179138.537333:0:11517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:3.0:1788179138.537342:0:11517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+43:2357:x1875041451033984:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788179138.537359:0:11517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179138.537365:0:11517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499102 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620b9 expref: 43 pid: 5827 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.537377:0:11517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499102 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620b9 expref: 43 pid: 5827 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.537399:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499102 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620b9 expref: 43 pid: 5827 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.537416:0:11517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc909481a00) 00010000:00010000:3.0:1788179138.537499:0:11517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49915d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.537508:0:11517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49915d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.537516:0:11517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49915d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.537544:0:11517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788179138.537573:0:5799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49915d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.537580:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49915d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179138.537612:0:11517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+42:2357:x1875041451033984:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 270us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179138.537619:0:11517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 51 00000001:00080000:0.0:1788179138.537701:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788179138.537922:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1788179138.538017:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93a82f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1875041472023552:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788179138.538060:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179138.538095:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc903247780 going to sleep for 11 seconds 00000100:00100000:3.0:1788179138.538150:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472023552 00000100:00100000:3.0:1788179138.538156:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472023552 00000100:00100000:3.0:1788179138.538277:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788179138.538283:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5799:x1875041472023552:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788179138.538346:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5799:x1875041472023552:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 63us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179138.538353:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788179138.539204:0:5799:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1788179138.539270:0:5799:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1788179138.539289:0:5799:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bc9358fb800, transno 4294967301 00000100:00100000:0.0:1788179138.539311:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93a82f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1875041472023552:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788179138.541401:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1788179138.542584:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b68f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1875041472023680:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788179138.542656:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179138.542694:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc918518e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788179138.542809:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472023680 00000100:00100000:3.0:1788179138.542817:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472023680 00000100:00100000:3.0:1788179138.542901:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788179138.542911:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b68f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5799:x1875041472023680:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788179138.543176:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b68f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5799:x1875041472023680:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 266us (519us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788179138.543184:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788179138.543296:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b68f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1875041472023680:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788179138.543349:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1788179138.543383:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49915d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.543391:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49915d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.543396:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49915d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.543400:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317ee00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179138.543403:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49915d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.543419:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49915d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.543435:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc909481a00) 00010000:00010000:0.0:1788179138.543438:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788179138.543442:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49915d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.543448:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49915d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788179138.543660:0:5799:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788179138.543722:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1788179138.543731:0:5799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 334606881189ns, next at 335606879156ns, rc = 0 00000001:00080000:0.0:1788179138.543737:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1788179138.543769:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc909481a00) 00010000:00010000:0.0:1788179138.543772:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788179138.543778:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499148 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620dc expref: 46 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179138.543968:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9266ff050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+45:10486:x1875041451033856:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 15035us (19324us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1788179138.543974:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 26 00000020:00080000:0.0:1788179138.543977:0:5799:0:(tgt_main.c:811:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788179138.547759:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179138.548142:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451034112 00000100:00100000:0.0:1788179138.548152:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451034112 00000100:00100000:0.0:1788179138.548217:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 100 00000100:00100000:0.0:1788179138.548228:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+45:10486:x1875041451034112:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788179138.548265:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179138.548290:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499164 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746620e3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.548347:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499164 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620e3 expref: 46 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.548362:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499164 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620e3 expref: 46 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.548381:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:0.0:1788179138.548384:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788179138.548388:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317fa00, rc 0) 00000100:00100000:0.0:1788179138.548461:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+46:10486:x1875041451034112:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 234us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179138.548468:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 100 00000100:00100000:1.0:1788179138.558965:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179138.559301:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451034368 00000100:00100000:2.0:1788179138.559313:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451034368 00000100:00100000:2.0:1788179138.559369:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:2.0:1788179138.559380:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+46:10486:x1875041451034368:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:2.0:1788179138.559710:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+47:10486:x1875041451034368:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 330us (755us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1788179138.559718:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:2.0:1788179138.648060:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179138.648268:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451034496 00000100:00100000:0.0:1788179138.648278:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451034496 00000100:00100000:0.0:1788179138.648428:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 101 00000100:00100000:0.0:1788179138.648440:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b68df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+47:10496:x1875041451034496:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:0.0:1788179138.648524:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49916b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.648542:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49916b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.648553:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49916b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.648700:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499172 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.648709:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.648716:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.648823:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c499179 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.648831:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c499179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.648837:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c499179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788179138.648923:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c499179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.648937:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49916b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.648943:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49916b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.648950:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49916b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.648956:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317ee00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179138.648960:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49916b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.648973:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49916b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.648984:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:0.0:1788179138.648987:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179138.648991:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49916b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.649110:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49916b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.649125:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.649130:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499172 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.649135:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499172 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.649141:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317e200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179138.649144:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499172 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.649151:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499172 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.649158:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bc9062cb800) 00010000:00010000:0.0:1788179138.649160:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179138.649163:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499172 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.649178:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499172 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.649191:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c499179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.649197:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c499179 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.649263:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c499179 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.649269:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317fc00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179138.649272:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c499179 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.649277:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c499179 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.649405:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:0.0:1788179138.649408:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179138.649411:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c499179 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.649417:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c499179 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179138.649611:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b68df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+47:10496:x1875041451034496:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 1171us (1628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179138.649621:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 101 00000100:00100000:1.0:1788179138.697261:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179138.697316:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179138.697346:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179138.697403:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179138.697447:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451035008 00000100:00100000:1.0:1788179138.697457:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451035008 00000100:00100000:1.0:1788179138.697508:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 77 00000100:00100000:1.0:1788179138.697519:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2357:x1875041451035008:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179138.697586:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2357:x1875041451035008:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 69us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179138.697593:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 77 00000100:00100000:0.0:1788179138.697684:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451034752 00000100:00100000:0.0:1788179138.697688:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451034752 00000100:00100000:0.0:1788179138.697724:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451035136 00000100:00100000:0.0:1788179138.697727:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451035136 00000100:00100000:0.0:1788179138.697758:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 136 00000100:00100000:0.0:1788179138.697765:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2357:x1875041451035136:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179138.697804:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2357:x1875041451035136:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 40us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179138.697810:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 136 00000100:00100000:0.0:1788179138.697826:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 102 00000100:00100000:0.0:1788179138.697831:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+47:10499:x1875041451034752:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788179138.697842:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179138.697908:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c499180 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746620ea expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.697972:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499187 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.697986:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499187 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.697997:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499187 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.698023:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49918e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.698030:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49918e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.698058:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49918e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.698176:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499195 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.698184:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499195 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.698191:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499195 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179138.698205:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788179138.698300:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499187 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.698307:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499187 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.698314:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499187 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.698319:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317e200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179138.698323:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499187 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.698331:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499187 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.698342:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:0.0:1788179138.698345:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179138.698356:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499187 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.698362:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499187 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.698375:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49918e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.698381:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49918e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.698386:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49918e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.698391:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317ee00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179138.698393:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49918e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.698398:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49918e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.698405:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bc9062cb800) 00010000:00010000:0.0:1788179138.698408:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179138.698410:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49918e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.698416:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c49918e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.698452:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c499180 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620ea expref: 50 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.698479:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499195 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620ea expref: 49 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.698487:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:0.0:1788179138.698489:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788179138.698492:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317f200, rc 0) 00000100:00100000:0.0:1788179138.698519:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+49:10499:x1875041451034752:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 687us (1269us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788179138.698526:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 102 00000100:00080000:0.0:1788179138.698551:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788179138.699473:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451034880 00000100:00100000:3.0:1788179138.699482:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451034880 00000100:00100000:3.0:1788179138.699527:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 289 00000100:00100000:3.0:1788179138.699535:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2357:x1875041451034880:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788179138.699581:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2357:x1875041451034880:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 47us (2264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179138.699597:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 289 00000100:00100000:1.0:1788179138.703404:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179138.703510:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451035264 00000100:00100000:0.0:1788179138.703519:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451035264 00000100:00100000:0.0:1788179138.703584:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 103 00000100:00100000:0.0:1788179138.703592:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+49:10499:x1875041451035264:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:0.0:1788179138.703659:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4991a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.703675:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4991a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.703688:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4991a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.703714:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4991a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.703721:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4991a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.703746:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4991a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.703752:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179138.703757:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4991a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.703764:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4991a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.703775:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:0.0:1788179138.703778:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788179138.703791:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4991a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.703798:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4991a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179138.703900:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+49:10499:x1875041451035264:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 308us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179138.703908:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 103 00000100:00100000:0.0:1788179138.712756:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179138.712912:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451035520 00000100:00100000:2.0:1788179138.712922:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451035520 00000100:00100000:2.0:1788179138.712980:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:2.0:1788179138.712991:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+49:10499:x1875041451035520:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:2.0:1788179138.713257:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+50:10499:x1875041451035520:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 267us (508us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788179138.713280:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:3.0:1788179138.806290:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179138.806411:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451035776 00000100:00100000:1.0:1788179138.806423:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451035776 00000100:00100000:1.0:1788179138.806496:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 104 00000100:00100000:1.0:1788179138.806507:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+50:10509:x1875041451035776:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:1.0:1788179138.806532:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179138.806535:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788179138.806562:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499125 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620ce expref: 50 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.806581:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:1.0:1788179138.806586:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788179138.806601:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c4991aa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746620f1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.806701:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c4991b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.806714:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499195 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620ea expref: 50 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.806741:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c4991b1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.806772:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499195 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620ea expref: 50 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.806973:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499195 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620ea expref: 50 pid: 5798 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179138.806989:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f7f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1875041472023808:192.168.202.2@tcp:104: 00000100:00100000:1.0:1788179138.807158:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93213be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788179138.813162:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179138.813407:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f7f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1875041472023808:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788179138.813434:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c4991b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179138.813944:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451035904 00000100:00100000:2.0:1788179138.813951:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451035904 00010000:00010000:2.0:1788179138.813997:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499195 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620ea expref: 51 pid: 5798 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179138.814039:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 52 00000100:00100000:2.0:1788179138.814048:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+51:2356:x1875041451035904:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788179138.814064:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179138.814070:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499195 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620ea expref: 51 pid: 5798 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.814081:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499195 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620ea expref: 51 pid: 5798 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.814105:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499195 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620ea expref: 51 pid: 5798 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.814120:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:2.0:1788179138.814125:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c4991b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.814133:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c4991b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.814140:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c4991b1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.814183:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788179138.814258:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+50:2356:x1875041451035904:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 211us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179138.814265:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 52 00010000:00010000:1.0:1788179138.814632:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c4991b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.814640:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c4991b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788179138.814660:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788179138.814820:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c4991aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620f1 expref: 51 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.814835:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c4991b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620f1 expref: 50 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.814901:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:1.0:1788179138.814904:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788179138.814907:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc92e12d000, rc 0) 00000100:00100000:1.0:1788179138.814941:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+50:10509:x1875041451035776:12345-192.168.202.2@tcp:101:bash.0 Request processed in 8436us (8662us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788179138.814960:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 104 00010000:00010000:3.0:1788179138.818276:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179138.821612:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179138.821910:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451036160 00000100:00100000:1.0:1788179138.821922:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451036160 00000100:00100000:1.0:1788179138.822001:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 105 00000100:00100000:1.0:1788179138.822012:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+50:10509:x1875041451036160:12345-192.168.202.2@tcp:36:bash.0 00010000:00010000:1.0:1788179138.822613:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c4991bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.822632:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c4991bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.822644:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c4991bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788179138.822690:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1788179138.822712:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f59f8ecb reply state 00000000254ed5ee transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c4991bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179138.822721:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788179138.822827:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+53:10509:x1875041451036160:12345-192.168.202.2@tcp:36:bash.0 Request processed in 816us (1223us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1788179138.822835:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 105 00000020:00080000:1.0:1788179138.822884:0:5798:0:(tgt_main.c:811:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788179138.830234:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c4991bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.830253:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c4991bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.830262:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c4991bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.830268:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92e12c200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179138.830273:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c4991bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.830281:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c4991bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.830377:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:3.0:1788179138.830388:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179138.830394:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c4991bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.830400:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c4991bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179138.830586:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179138.840992:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451036288 00000100:00100000:2.0:1788179138.841010:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451036288 00000100:00100000:2.0:1788179138.841103:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 106 00000100:00100000:2.0:1788179138.841117:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+52:10509:x1875041451036288:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1788179138.841143:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179138.841166:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c4991c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746620f8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.841280:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4991cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.841295:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c4991b1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620f1 expref: 53 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.841305:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4991cd lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.841342:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c4991b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620f1 expref: 53 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.841356:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c4991b1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620f1 expref: 53 pid: 5796 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179138.841372:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b68fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5827:1875041472023936:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788179138.841787:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc909982480 going to sleep for 11 seconds 00000100:00100000:3.0:1788179138.845335:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b68fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5827:1875041472023936:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788179138.845366:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4991cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179138.848231:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179138.848763:0:11517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451036416 00000100:00100000:3.0:1788179138.848774:0:11517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451036416 00010000:00010000:3.0:1788179138.848816:0:11517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c4991b1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620f1 expref: 54 pid: 5796 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179138.848890:0:11517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 53 00000100:00100000:3.0:1788179138.848901:0:11517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+54:2357:x1875041451036416:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788179138.848919:0:11517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179138.848926:0:11517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c4991b1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620f1 expref: 54 pid: 5796 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.848940:0:11517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c4991b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620f1 expref: 54 pid: 5796 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.848966:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c4991b1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620f1 expref: 54 pid: 5796 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.848985:0:11517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:3.0:1788179138.848990:0:11517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4991cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.849002:0:11517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4991cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.849012:0:11517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4991cd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.849146:0:11517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179138.849229:0:11517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+53:2357:x1875041451036416:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 329us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179138.849238:0:11517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 53 00010000:00010000:2.0:1788179138.852667:0:5827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4991cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.852687:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4991cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179138.852744:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788179138.852748:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788179138.852769:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4991cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.852819:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c4991c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620f8 expref: 53 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.852840:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4991cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620f8 expref: 52 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179138.852899:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:2.0:1788179138.852902:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788179138.852906:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c5800, rc 0) 00000100:00100000:2.0:1788179138.852978:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+52:10509:x1875041451036288:12345-192.168.202.2@tcp:101:bash.0 Request processed in 11863us (22395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179138.852987:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 106 00000100:00100000:0.0:1788179138.861533:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179138.861653:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451036672 00000100:00100000:2.0:1788179138.861664:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451036672 00000100:00100000:2.0:1788179138.861730:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:2.0:1788179138.861741:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+52:10509:x1875041451036672:12345-192.168.202.2@tcp:35:bash.0 00000100:00100000:2.0:1788179138.862034:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+53:10509:x1875041451036672:12345-192.168.202.2@tcp:35:bash.0 Request processed in 294us (518us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1788179138.862052:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:2.0:1788179138.933799:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179138.933964:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451036800 00000100:00100000:0.0:1788179138.933973:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451036800 00000100:00100000:0.0:1788179138.934047:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 107 00000100:00100000:0.0:1788179138.934058:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b68d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+53:10515:x1875041451036800:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788179138.934083:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179138.934104:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4991d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746620ff expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.934165:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4991db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.934179:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4991db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.934189:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4991db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179138.934246:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1788179138.934249:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788179138.934268:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4991db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.934290:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4991d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620ff expref: 55 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.934307:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4991db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620ff expref: 54 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.934315:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:0.0:1788179138.934318:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788179138.934322:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317ee00, rc 0) 00000100:00100000:0.0:1788179138.934381:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b68d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+54:10515:x1875041451036800:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 324us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179138.934395:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 107 00000100:00100000:0.0:1788179138.938689:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179138.938841:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451036928 00000100:00100000:1.0:1788179138.938896:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451036928 00000100:00100000:1.0:1788179138.938958:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 108 00000100:00100000:1.0:1788179138.938967:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+54:10515:x1875041451036928:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788179138.938988:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179138.939010:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c4991e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662106 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.939086:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c4991e9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.939100:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c4991e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.939112:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c4991e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.939126:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c4991f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.939134:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c4991f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.939141:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c4991f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.939249:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c4991f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.939258:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c4991f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.939284:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c4991f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788179138.939321:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788179138.939325:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788179138.939341:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c4991f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.939352:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c4991f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.939360:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c4991e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.939366:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c4991e9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.939372:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c4991e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.939377:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92e12c400 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179138.939381:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c4991e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.939388:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c4991e9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.939399:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:1.0:1788179138.939403:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179138.939407:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c4991e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.939423:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c4991e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.939437:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c4991f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.939443:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c4991f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.939448:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c4991f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.939453:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92e12de00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179138.939455:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c4991f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.939461:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c4991f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.939468:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bc903340e00) 00010000:00010000:1.0:1788179138.939471:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179138.939473:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c4991f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.939478:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c4991f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.939507:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c4991e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662106 expref: 56 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.939518:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c4991f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662106 expref: 55 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.939531:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:1.0:1788179138.939533:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788179138.939536:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc92e12dc00, rc 0) 00000100:00100000:1.0:1788179138.939675:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+55:10515:x1875041451036928:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 708us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179138.939683:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 108 00000100:00100000:2.0:1788179138.946048:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179138.946136:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451037056 00000100:00100000:1.0:1788179138.946148:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451037056 00000100:00100000:1.0:1788179138.946218:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:1.0:1788179138.946229:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b68c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+55:2357:x1875041451037056:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788179138.946245:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788179138.946269:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c4991f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662106 expref: 55 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.946287:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:1.0:1788179138.946291:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788179138.946337:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b68c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+54:2357:x1875041451037056:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 110us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179138.946345:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:0.0:1788179138.947215:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179138.947364:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451037312 00000100:00100000:3.0:1788179138.947372:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451037312 00000100:00100000:3.0:1788179138.947417:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 109 00000100:00100000:3.0:1788179138.947426:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+54:10515:x1875041451037312:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1788179138.947446:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179138.947464:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c4991fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466210d expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.947681:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499205 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.947697:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4991cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620f8 expref: 55 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.947706:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499205 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.947741:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4991cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620f8 expref: 55 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179138.947755:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4991cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620f8 expref: 55 pid: 5827 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179138.947768:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f878e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1875041472024064:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788179138.947891:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc902f9b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788179138.960957:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179138.961058:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f878e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1875041472024064:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788179138.961086:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499205 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179138.961179:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451037440 00000100:00100000:1.0:1788179138.961188:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451037440 00010000:00010000:1.0:1788179138.961225:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4991cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620f8 expref: 56 pid: 5827 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179138.961266:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 54 00000100:00100000:1.0:1788179138.961276:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90710dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+56:2356:x1875041451037440:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788179138.961318:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788179138.961327:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4991cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620f8 expref: 56 pid: 5827 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.961340:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4991cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620f8 expref: 56 pid: 5827 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.961363:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4991cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620f8 expref: 56 pid: 5827 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.961378:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:1.0:1788179138.961383:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499205 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.961392:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499205 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.961399:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499205 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.961420:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788179138.961464:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90710dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+55:2356:x1875041451037440:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 189us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179138.961471:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 54 00010000:00010000:0.0:1788179138.961841:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499205 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.961882:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499205 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179138.961902:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788179138.962050:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c4991fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466210d expref: 56 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.962068:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499205 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466210d expref: 55 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179138.962075:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:0.0:1788179138.962078:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788179138.962080:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4200, rc 0) 00000100:00100000:0.0:1788179138.962108:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+55:10515:x1875041451037312:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 14684us (14898us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1788179138.962114:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 109 00000100:00100000:2.0:1788179138.967966:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179138.968048:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451037696 00000100:00100000:1.0:1788179138.968058:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451037696 00000100:00100000:1.0:1788179138.968126:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:1.0:1788179138.968137:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b68d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+55:10515:x1875041451037696:12345-192.168.202.2@tcp:103:lfs.0 00010000:00010000:1.0:1788179138.968170:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788179138.968200:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499164 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620e3 expref: 55 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.968221:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:1.0:1788179138.968226:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788179138.968281:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b68d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+54:10515:x1875041451037696:12345-192.168.202.2@tcp:103:lfs.0 Request processed in 145us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179138.968288:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:2.0:1788179138.972733:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179138.972806:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451037824 00000100:00100000:1.0:1788179138.972816:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451037824 00000100:00100000:1.0:1788179138.972903:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 110 00000100:00100000:1.0:1788179138.972912:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b68e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+54:10515:x1875041451037824:12345-192.168.202.2@tcp:58:lfs.0 00010000:00010000:1.0:1788179138.973029:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c499213 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.973045:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c499213 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.973056:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c499213 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788179138.973228:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788179138.973320:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b68e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+54:10515:x1875041451037824:12345-192.168.202.2@tcp:58:lfs.0 Request processed in 408us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179138.973328:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 110 00000100:00100000:0.0:1788179138.983790:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179138.983917:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451037952 00000100:00100000:1.0:1788179138.983928:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451037952 00000100:00100000:1.0:1788179138.984001:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 111 00000100:00100000:1.0:1788179138.984011:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+54:10515:x1875041451037952:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788179138.984031:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179138.984050:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c49921a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662114 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.984108:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c499213 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.984120:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c49921a lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662114 expref: 55 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.984139:0:5798:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c499213 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.984152:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c49921a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662114 expref: 55 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.984165:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:1.0:1788179138.984167:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788179138.984172:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c49921a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662114 expref: 55 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179138.984180:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc92e12d600, rc 0) 00000100:00100000:1.0:1788179138.984241:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+55:10515:x1875041451037952:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 231us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179138.984248:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 111 00000040:00080000:0.0:1788179139.008141:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788179139.008151:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788179139.008197:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788179139.008204:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788179139.008356:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93a82f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1875041472024192:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788179139.008451:0:11535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9063849c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788179139.014303:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179139.014460:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93a82f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1875041472024192:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788179139.014720:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451038080 00000100:00100000:1.0:1788179139.014740:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451038080 00000100:00100000:1.0:1788179139.014813:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 112 00000100:00100000:1.0:1788179139.014822:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+55:10516:x1875041451038080:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788179139.014892:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788179139.014978:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+55:10516:x1875041451038080:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 158us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179139.014985:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 112 00000100:00080000:0.0:1788179139.017316:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788179139.019045:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179139.020012:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451038208 00000100:00100000:1.0:1788179139.020025:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451038208 00000100:00100000:1.0:1788179139.020097:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 113 00000100:00100000:1.0:1788179139.020108:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+55:10516:x1875041451038208:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788179139.020187:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c499221 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020204:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c499221 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020215:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c499221 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020228:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c499228 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020235:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c499228 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020242:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c499228 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020267:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c49922f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020289:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c49922f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020297:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c49922f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788179139.020337:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788179139.020341:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788179139.020353:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c49922f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020364:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c499221 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020370:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c499221 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020377:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c499221 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020384:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92e12de00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179139.020388:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c499221 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020396:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c499221 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020408:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bc903340c00) 00010000:00010000:1.0:1788179139.020411:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179139.020415:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c499221 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020549:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c499221 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020563:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c499228 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020569:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c499228 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020642:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c499228 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020647:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92e12c400 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179139.020650:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c499228 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020656:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c499228 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020664:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9bc903340e00) 00010000:00010000:1.0:1788179139.020667:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179139.020670:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c499228 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020675:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c499228 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020689:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c49922f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020694:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c49922f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020705:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c49922f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020710:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92e12d000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179139.020713:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c49922f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020718:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c49922f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020724:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:1.0:1788179139.020726:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179139.020729:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c49922f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.020734:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c49922f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179139.021435:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+55:10516:x1875041451038208:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 Request processed in 1314us (2384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179139.021445:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 113 00000100:00100000:2.0:1788179139.025086:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179139.025182:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451038464 00000100:00100000:1.0:1788179139.025193:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451038464 00000100:00100000:1.0:1788179139.025361:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 114 00000100:00100000:1.0:1788179139.025372:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b68f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+55:10516:x1875041451038464:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788179139.025393:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179139.025413:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c499236 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466211b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.025522:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173c00/0xaa4c98508c49923d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.025536:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173c00/0xaa4c98508c49923d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.025561:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173c00/0xaa4c98508c49923d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788179139.026151:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788179139.026274:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173c00/0xaa4c98508c49923d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.026283:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173c00/0xaa4c98508c49923d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.026290:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173c00/0xaa4c98508c49923d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.026296:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc942173c00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179139.026301:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173c00/0xaa4c98508c49923d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.026308:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173c00/0xaa4c98508c49923d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.026321:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:1.0:1788179139.026324:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788179139.026328:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173c00/0xaa4c98508c49923d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.026333:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173c00/0xaa4c98508c49923d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.026379:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c499236 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466211b expref: 57 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.026413:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bc903340c00) 00010000:00010000:1.0:1788179139.026416:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788179139.026420:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c499236 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466211b expref: 57 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.026516:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc92e12c200, rc 0) 00000100:00100000:1.0:1788179139.026684:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b68f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+56:10516:x1875041451038464:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 1313us (1961us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1788179139.026692:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 114 00000100:00100000:0.0:1788179139.032110:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179139.032234:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451038592 00000100:00100000:3.0:1788179139.032244:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451038592 00000100:00100000:3.0:1788179139.032339:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 115 00000100:00100000:3.0:1788179139.032350:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+56:10516:x1875041451038592:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788179139.032404:0:5797:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788179139.032522:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+56:10516:x1875041451038592:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 173us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179139.032531:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 115 00000100:00100000:2.0:1788179139.037342:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179139.037477:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451038848 00000100:00100000:3.0:1788179139.037488:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451038848 00000100:00100000:3.0:1788179139.037573:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 116 00000100:00100000:3.0:1788179139.037584:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b68c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+56:10516:x1875041451038848:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788179139.037606:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179139.037609:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788179139.037635:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4991db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620ff expref: 56 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.037654:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:3.0:1788179139.037659:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788179139.037672:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c49924b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662122 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788179139.038147:0:5827:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788179139.038361:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c499252 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.038375:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c499252 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.038386:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c499252 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.038448:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c49924b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662122 expref: 58 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.038464:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c499252 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662122 expref: 57 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.038471:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bc903312600) 00010000:00010000:3.0:1788179139.038474:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788179139.038476:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b5a00, rc 0) 00000100:00100000:3.0:1788179139.038550:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b68c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+57:10516:x1875041451038848:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 967us (1215us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1788179139.038557:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 116 00000100:00100000:0.0:1788179139.043744:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179139.044070:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451039104 00000100:00100000:2.0:1788179139.044080:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451039104 00000100:00100000:2.0:1788179139.044160:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 117 00000100:00100000:2.0:1788179139.044171:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+57:10516:x1875041451039104:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788179139.044237:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179139.044263:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c499252 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662122 expref: 57 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.044279:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bc903312600) 00010000:00010000:2.0:1788179139.044289:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788179139.044309:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499260 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.044321:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499260 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.044328:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499260 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.044356:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499267 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x11baaad4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.044364:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499267 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x11baaad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.044370:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499267 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x11baaad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.044454:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499260 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.044461:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499260 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.044468:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499260 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.044474:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5600 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179139.044478:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499260 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.044486:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499260 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.044495:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:2.0:1788179139.044498:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179139.044502:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499260 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.044508:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499260 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.044524:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499267 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x11baaad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.044530:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499267 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x11baaad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.044536:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499267 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x11baaad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.044541:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179139.044544:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499267 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x11baaad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.044550:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499267 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x11baaad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.044559:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x11baaad4 (ffff9bc909481300) 00010000:00010000:2.0:1788179139.044561:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179139.044564:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499267 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x11baaad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.044570:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499267 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x11baaad4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179139.044665:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+56:10516:x1875041451039104:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 494us (929us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788179139.044673:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 117 00000100:00100000:0.0:1788179139.046951:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179139.047055:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451039232 00000100:00100000:1.0:1788179139.047063:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451039232 00000100:00100000:1.0:1788179139.047109:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 118 00000100:00100000:1.0:1788179139.047118:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+56:10516:x1875041451039232:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788179139.047136:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179139.047156:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173c00/0xaa4c98508c49926e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662129 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.047190:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173000/0xaa4c98508c499275 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.047202:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173000/0xaa4c98508c499275 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.047224:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173000/0xaa4c98508c499275 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.047320:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173c00/0xaa4c98508c49926e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662129 expref: 58 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.047346:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173000/0xaa4c98508c499275 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662129 expref: 57 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.047353:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bc903340e00) 00010000:00010000:1.0:1788179139.047356:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788179139.047359:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc942173000, rc 0) 00000100:00100000:1.0:1788179139.047408:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+57:10516:x1875041451039232:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 292us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179139.047416:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 118 00000100:00100000:0.0:1788179139.050281:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179139.050352:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451039488 00000100:00100000:3.0:1788179139.050362:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451039488 00000100:00100000:3.0:1788179139.050445:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 119 00000100:00100000:3.0:1788179139.050456:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+57:10516:x1875041451039488:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788179139.050528:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c49927c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.050558:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c49927c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.050570:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c49927c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788179139.050827:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:3.0:1788179139.050957:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006dd1eb63 reply state 00000000879f3689 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c49927c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179139.050967:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788179139.051048:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+59:10516:x1875041451039488:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 594us (776us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1788179139.051055:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 119 00010000:00010000:3.0:1788179139.053616:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c49927c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.053633:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c49927c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.053640:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c49927c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.053646:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4600 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179139.053650:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c49927c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.053659:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c49927c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.053675:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bc903340e00) 00010000:00010000:3.0:1788179139.053694:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788179139.053699:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c49927c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.053705:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c49927c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179139.053845:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179139.054349:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451039616 00000100:00100000:3.0:1788179139.054357:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451039616 00000100:00100000:3.0:1788179139.054403:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 120 00000100:00100000:3.0:1788179139.054413:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+58:10516:x1875041451039616:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788179139.054437:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179139.054455:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499283 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662130 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.054519:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499283 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662130 expref: 59 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.054531:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499283 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662130 expref: 59 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.054551:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bc903340e00) 00010000:00010000:3.0:1788179139.054554:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788179139.054557:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b5600, rc 0) 00000100:00100000:3.0:1788179139.054658:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+59:10516:x1875041451039616:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 246us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179139.054665:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 120 00000100:00100000:0.0:1788179139.059514:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179139.059608:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451039744 00000100:00100000:3.0:1788179139.059618:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451039744 00000100:00100000:3.0:1788179139.059737:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 37 00000100:00100000:3.0:1788179139.059747:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2356:x1875041451039744:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788179139.060071:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+9:2356:x1875041451039744:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 325us (566us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788179139.060079:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 37 00000100:00100000:2.0:1788179139.062798:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179139.062897:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451040000 00000100:00100000:3.0:1788179139.062907:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451040000 00000100:00100000:3.0:1788179139.062960:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 30 00000100:00100000:3.0:1788179139.062969:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b68fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+59:10516:x1875041451040000:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788179139.063186:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b68fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+60:10516:x1875041451040000:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 217us (404us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1788179139.063193:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 30 00000100:00080000:0.0:1788179139.065581:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788179139.066498:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179139.066616:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451040256 00000100:00100000:0.0:1788179139.066626:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451040256 00000100:00100000:0.0:1788179139.066683:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 121 00000100:00100000:0.0:1788179139.066693:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+60:10516:x1875041451040256:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788179139.066809:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+60:10516:x1875041451040256:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 118us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179139.066817:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 121 00000100:00100000:2.0:1788179139.069098:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179139.069306:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451040384 00000100:00100000:3.0:1788179139.069315:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451040384 00000100:00100000:3.0:1788179139.069393:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 122 00000100:00100000:3.0:1788179139.069403:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+60:10516:x1875041451040384:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788179139.069576:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179139.069609:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c49928a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662137 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.069752:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c499291 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.069766:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c499291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.069788:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c499291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179139.069831:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788179139.069935:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c499291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.069963:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c49928a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662137 expref: 62 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.069982:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c499291 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662137 expref: 61 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.069991:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bc903340e00) 00010000:00010000:3.0:1788179139.069994:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788179139.069997:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4400, rc 0) 00000100:00100000:3.0:1788179139.070099:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+61:10516:x1875041451040384:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 697us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179139.070107:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 122 00000100:00100000:2.0:1788179139.073328:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179139.073403:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451040512 00000100:00100000:1.0:1788179139.073412:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451040512 00000100:00100000:1.0:1788179139.073616:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:1.0:1788179139.073626:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+9:2357:x1875041451040512:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788179139.073643:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179139.073665:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029ddc449/0xaa4c98508c499298 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466213e expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788179139.073692:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9572c2, blocks: 0x1 00010000:00010000:1.0:1788179139.073709:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=335s v=(0 0) 00010000:00010000:1.0:1788179139.073713:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179139.073721:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029ddc449/0xaa4c98508c499298 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466213e expref: 10 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.073738:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000029ddc449/0xaa4c98508c499298 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466213e expref: 10 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.073768:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc942173e00, rc 0) 00000100:00100000:1.0:1788179139.073918:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+10:2357:x1875041451040512:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 293us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179139.073925:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:2.0:1788179139.077568:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179139.077777:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451040768 00000100:00100000:0.0:1788179139.077977:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451040768 00000100:00100000:0.0:1788179139.078067:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 123 00000100:00100000:0.0:1788179139.078078:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+61:10516:x1875041451040768:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788179139.078280:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+61:10516:x1875041451040768:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 203us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179139.078288:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 123 00000100:00100000:0.0:1788179139.081170:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179139.081322:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451040896 00000100:00100000:3.0:1788179139.081332:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451040896 00000100:00100000:3.0:1788179139.081507:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:3.0:1788179139.081517:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+10:10516:x1875041451040896:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788179139.081547:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179139.081585:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f8d7c41/0xaa4c98508c49929f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662145 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.081640:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000029ddc449/0xaa4c98508c499298 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466213e expref: 11 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.081701:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788179139.081705:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788179139.081711:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f8d7c41/0xaa4c98508c49929f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662145 expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.081794:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000029ddc449/0xaa4c98508c499298 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466213e expref: 11 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.081828:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000029ddc449/0xaa4c98508c499298 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466213e expref: 11 pid: 6591 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179139.081843:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f879180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6590:1875041472024320:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788179139.081964:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9051da300 going to sleep for 11 seconds 00000100:00100000:2.0:1788179139.084488:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179139.084577:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f879180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6590:1875041472024320:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788179139.084609:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f8d7c41/0xaa4c98508c49929f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662145 expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.084630:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b5000, rc 0) 00000100:00100000:3.0:1788179139.084685:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+11:10516:x1875041451040896:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 3170us (3523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179139.084694:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:0.0:1788179139.084768:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451041024 00000100:00100000:0.0:1788179139.084797:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451041024 00010000:00010000:0.0:1788179139.084827:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000029ddc449/0xaa4c98508c499298 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466213e expref: 11 pid: 6591 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179139.084909:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:0.0:1788179139.084917:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+11:2357:x1875041451041024:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179139.084932:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179139.084952:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000029ddc449/0xaa4c98508c499298 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466213e expref: 11 pid: 6591 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.084965:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000029ddc449/0xaa4c98508c499298 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466213e expref: 11 pid: 6591 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.084988:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029ddc449/0xaa4c98508c499298 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466213e expref: 11 pid: 6591 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.085002:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788179139.085007:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788179139.085015:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007f8d7c41/0xaa4c98508c49929f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662145 expref: 10 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.085026:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f8d7c41/0xaa4c98508c49929f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662145 expref: 10 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.085057:0:5781:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007f8d7c41/0xaa4c98508c49929f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662145 expref: 10 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179139.085082:0:5781:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0f7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5781:1875041472024448:192.168.202.2@tcp:105: 00000100:00100000:0.0:1788179139.085129:0:5781:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9063849c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788179139.091082:0:5781:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0f7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5781:1875041472024448:192.168.202.2@tcp:105: 00010000:00010000:1.0:1788179139.091109:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788179139.091169:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+10:2357:x1875041451041024:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 6252us (6690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179139.091179:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:2.0:1788179139.091761:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179139.091832:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451041152 00000100:00100000:3.0:1788179139.091841:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451041152 00002000:00100000:3.0:1788179139.091919:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9bc90703aa00 x1875041451041152/t0(0) o4->334bb25c-6762-4beb-8a84-3a838cbc7e80@192.168.202.2@tcp:155/0 lens 504/0 e 0 to 0 dl 1788179150 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788179139.091942:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bc90703aa00 with x1875041451041152 ext(0->12) 00002000:00010000:3.0:1788179139.091948:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bc90703aa00 00000100:00100000:3.0:1788179139.091982:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:3.0:1788179139.091989:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90703aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+10:2357:x1875041451041152:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788179139.093076:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90703aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+12:2357:x1875041451041152:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 Request processed in 1081us (1310us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788179139.093090:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 2 00002000:00100000:0.0:1788179139.093097:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9bc90703aa00 x1875041451041152/t4294967308(0) o4->334bb25c-6762-4beb-8a84-3a838cbc7e80@192.168.202.2@tcp:155/0 lens 504/448 e 0 to 0 dl 1788179150 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788179139.093105:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bc90703aa00 with x1875041451041152 ext(0->12) 00002000:00010000:0.0:1788179139.093110:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bc90703aa00 00000100:00100000:2.0:1788179139.098195:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179139.098276:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451041280 00000100:00100000:1.0:1788179139.098286:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451041280 00000100:00100000:1.0:1788179139.098342:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 124 00000100:00100000:1.0:1788179139.098351:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+61:10516:x1875041451041280:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788179139.128097:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+61:10516:x1875041451041280:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 Request processed in 29735us (29899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179139.128111:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 124 00000001:00080000:0.0:1788179139.128188:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967396 is committed 00000004:00080000:0.0:1788179139.128213:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:0.0:1788179139.128250:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788179139.128277:0:5818:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bc9359ea780 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788179139.128583:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9bc9353a0f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bc9359eacc0 00000020:00080000:0.0:1788179139.128586:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9bc9353a0d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bc93a878000 00000020:00080000:3.0:1788179139.128678:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 2 committed batchid 1 00000020:00080000:3.0:1788179139.128882:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000001:00080000:0.0:1788179139.128990:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000020:00080000:0.0:1788179139.129020:0:5818:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bc905cfe480 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788179139.129024:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9bc9353a0600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bc905cfe840 00000020:00080000:0.0:1788179139.129026:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9bc9353a0b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bc93a5d4400 00000001:00080000:0.0:1788179139.129051:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000100:00100000:0.0:1788179139.129083:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788179139.129100:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f879180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472024576:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788179139.129175:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788179139.129295:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1788179139.129325:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788179139.129696:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc907039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472024704:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788179139.129728:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179139.129810:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472024576 00000100:00100000:2.0:1788179139.129819:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472024576 00000100:00100000:2.0:1788179139.129899:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472024704 00000100:00100000:2.0:1788179139.129903:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472024704 00000100:00100000:2.0:1788179139.129928:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788179139.129935:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875041472024576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788179139.129962:0:6589:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1788179139.129997:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9572c1, atime: 0x6a9572c1, ctime: 0x6a9572c1, blocks: 0x1 00010000:00010000:2.0:1788179139.130004:0:6589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005c29ec3/0xaa4c98508c4992a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.130020:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=335s v=(0 0) 00010000:00010000:2.0:1788179139.130025:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179139.130032:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005c29ec3/0xaa4c98508c4992a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.130047:0:6589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005c29ec3/0xaa4c98508c4992a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.130056:0:6589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005c29ec3/0xaa4c98508c4992a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.130064:0:6589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005c29ec3/0xaa4c98508c4992a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.130092:0:6589:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788179139.130951:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1875041472024576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1012us (1771us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788179139.130961:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788179139.130986:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788179139.130994:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875041472024704:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788179139.131013:0:6589:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1788179139.131030:0:6589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c4992ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.131053:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000052bc5d45/0xaa4c98508c499068 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746620a4 expref: 11 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.131061:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788179139.131065:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788179139.131069:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c4992ad lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.131096:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000052bc5d45/0xaa4c98508c499068 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620a4 expref: 11 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.131110:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000052bc5d45/0xaa4c98508c499068 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620a4 expref: 11 pid: 6589 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179139.131123:0:6589:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc90703b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6589:1875041472024832:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788179139.131186:0:6589:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc803c6f900 going to sleep for 11 seconds 00000100:00080000:2.0:1788179139.131222:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788179139.131226:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788179139.131239:0:6605:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788179139.131245:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005c29ec3/0xaa4c98508c4992a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.131253:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5600 already unused, calling callback (ffffffffc1644220) 00010000:00010000:2.0:1788179139.131257:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005c29ec3/0xaa4c98508c4992a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.131267:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005c29ec3/0xaa4c98508c4992a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.131577:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005c29ec3/0xaa4c98508c4992a6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.131586:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005c29ec3/0xaa4c98508c4992a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.131623:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179139.131626:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179139.131627:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788179139.131661:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bc93f879180/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788179139.131668:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f879180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472024576:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788179139.139111:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179139.139154:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179139.139251:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451041536 00000100:00100000:0.0:1788179139.139261:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451041536 00010000:00010000:0.0:1788179139.139311:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000052bc5d45/0xaa4c98508c499068 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620a4 expref: 12 pid: 6589 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179139.139355:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 56 00000100:00100000:0.0:1788179139.140445:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+12:2356:x1875041451041536:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179139.140466:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179139.140474:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000052bc5d45/0xaa4c98508c499068 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620a4 expref: 12 pid: 6589 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.140491:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000052bc5d45/0xaa4c98508c499068 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620a4 expref: 12 pid: 6589 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.140517:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788179139.140521:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788179139.140527:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c4992ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.140538:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c4992ad lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.140559:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179139.140649:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+12:2356:x1875041451041536:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 1284us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179139.140658:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 56 00000100:00100000:1.0:1788179139.141104:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451041408 00000100:00100000:1.0:1788179139.141113:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451041408 00000100:00100000:1.0:1788179139.141156:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:1.0:1788179139.141164:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90703a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+12:2356:x1875041451041408:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1788179139.143314:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052bc5d45/0xaa4c98508c499068 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.2@tcp remote: 0x34c7c424746620a4 expref: 12 pid: 6589 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179139.143338:0:6589:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc90703b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6589:1875041472024832:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788179139.143363:0:6589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c4992ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.143373:0:6589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c4992ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.143380:0:6589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c4992ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.143406:0:6589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c4992ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.143414:0:6589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c4992ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.143432:0:6589:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788179139.145437:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1875041472024704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14437us (15700us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788179139.145450:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:1.0:1788179139.145823:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788179139.145834:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c4992ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.145876:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5000 already unused, calling callback (ffffffffc1644220) 00010000:00010000:1.0:1788179139.145881:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c4992ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.145906:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c4992ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.145925:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c4992ad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.145934:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c4992ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.145959:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179139.145961:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179139.145962:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788179139.146290:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bc907039180/2, rc 0, transno 4294967309 00000100:00100000:3.0:1788179139.146308:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc907039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472024704:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1788179139.178416:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:3.0:1788179139.178436:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:1.0:1788179139.178594:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90703a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2356:x1875041451041408:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 Request processed in 37425us (39489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179139.178615:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:2.0:1788179139.182028:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179139.182112:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451041792 00000100:00100000:3.0:1788179139.182123:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451041792 00000100:00100000:3.0:1788179139.182183:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 125 00000100:00100000:3.0:1788179139.182193:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+15:10516:x1875041451041792:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788179139.182255:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179139.182284:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c499291 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662137 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.182302:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bc903340e00) 00010000:00010000:3.0:1788179139.182308:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788179139.182348:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4992b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.182361:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4992b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.182371:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4992b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788179139.182965:0:5827:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000194ee0e9 reply state 00000000a9bb4ef1 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4992b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179139.182980:0:5827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788179139.183096:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+16:10516:x1875041451041792:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 903us (1077us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1788179139.183104:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 125 00010000:00010000:3.0:1788179139.185238:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4992b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.185256:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4992b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.185264:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4992b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.185270:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4600 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179139.185275:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4992b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.185282:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4992b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.185296:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bc903340e00) 00010000:00010000:3.0:1788179139.185311:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179139.185316:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4992b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.185321:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4992b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179139.187171:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179139.187447:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451041920 00000100:00100000:3.0:1788179139.187459:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451041920 00000100:00100000:3.0:1788179139.187515:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:3.0:1788179139.187525:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2356:x1875041451041920:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788179139.187732:0:6591:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788179139.187736:0:6591:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788179138 00002000:00010000:3.0:1788179139.187738:0:6591:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788179137 00002000:00010000:3.0:1788179139.187740:0:6591:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788179138 -> 1788179138 00002000:00010000:3.0:1788179139.187743:0:6591:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788179139.187825:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2356:x1875041451041920:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 300us (665us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788179139.187832:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:2.0:1788179139.191246:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179139.191336:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451042176 00000100:00100000:3.0:1788179139.191345:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451042176 00000100:00100000:3.0:1788179139.191407:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 126 00000100:00100000:3.0:1788179139.191417:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+15:10516:x1875041451042176:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788179139.191496:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c4992bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.191514:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173000/0xaa4c98508c499275 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662129 expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.191541:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c4992bb lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.191578:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173000/0xaa4c98508c499275 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662129 expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.191592:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173000/0xaa4c98508c499275 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662129 expref: 15 pid: 5796 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179139.191617:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f878380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1875041472024960:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788179139.191701:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9054b4600 going to sleep for 11 seconds 00000100:00100000:3.0:1788179139.194301:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f878380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1875041472024960:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788179139.194335:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c4992bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179139.195399:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179139.195813:0:11517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451042304 00000100:00100000:0.0:1788179139.195821:0:11517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451042304 00010000:00010000:0.0:1788179139.195907:0:11517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173000/0xaa4c98508c499275 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662129 expref: 16 pid: 5796 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179139.195940:0:11517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00100000:0.0:1788179139.195949:0:11517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+16:2356:x1875041451042304:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179139.195963:0:11517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179139.195970:0:11517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173000/0xaa4c98508c499275 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662129 expref: 16 pid: 5796 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.195981:0:11517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173000/0xaa4c98508c499275 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662129 expref: 16 pid: 5796 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.196004:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173000/0xaa4c98508c499275 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662129 expref: 16 pid: 5796 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.196019:0:11517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bc903340e00) 00010000:00010000:0.0:1788179139.196024:0:11517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c4992bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.196033:0:11517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c4992bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.196040:0:11517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c4992bb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.196082:0:11517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179139.196131:0:11517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+15:2356:x1875041451042304:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 183us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179139.196138:0:11517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 57 00010000:00010000:3.0:1788179139.196351:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c4992bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.196360:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c4992bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.196391:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c4992bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.196398:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c4992bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.196405:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c4992bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.196417:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4400 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179139.196433:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c4992bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.196441:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c4992bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.196451:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bc903340e00) 00010000:00010000:3.0:1788179139.196454:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788179139.196457:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c4992bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.196463:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c4992bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179139.196506:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+14:10516:x1875041451042176:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 Request processed in 5091us (5275us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788179139.196515:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 126 00000100:00100000:0.0:1788179139.199375:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179139.199451:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451042432 00000100:00100000:3.0:1788179139.199460:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451042432 00000100:00100000:3.0:1788179139.199516:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:3.0:1788179139.199526:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2356:x1875041451042432:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788179139.199580:0:6589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006daf256f/0xaa4c98508c4992c2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.199614:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f8d7c41/0xaa4c98508c49929f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662145 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.199646:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788179139.199651:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788179139.199656:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006daf256f/0xaa4c98508c4992c2 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.199691:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007f8d7c41/0xaa4c98508c49929f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662145 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.199705:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007f8d7c41/0xaa4c98508c49929f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662145 expref: 7 pid: 6590 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179139.199720:0:6589:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f878380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6589:1875041472025088:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788179139.199793:0:6589:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9054b4600 going to sleep for 11 seconds 00000100:00100000:3.0:1788179139.202401:0:6589:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f878380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6589:1875041472025088:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788179139.202426:0:6589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006daf256f/0xaa4c98508c4992c2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179139.204004:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179139.204091:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451042560 00000100:00100000:2.0:1788179139.204108:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451042560 00010000:00010000:2.0:1788179139.204147:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007f8d7c41/0xaa4c98508c49929f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662145 expref: 8 pid: 6590 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179139.204189:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 58 00000100:00100000:2.0:1788179139.204198:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b611500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2356:x1875041451042560:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788179139.204212:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179139.204235:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007f8d7c41/0xaa4c98508c49929f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662145 expref: 8 pid: 6590 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.204248:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007f8d7c41/0xaa4c98508c49929f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662145 expref: 8 pid: 6590 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.204271:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f8d7c41/0xaa4c98508c49929f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662145 expref: 8 pid: 6590 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.204285:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788179139.204290:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788179139.204296:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006daf256f/0xaa4c98508c4992c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.204306:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006daf256f/0xaa4c98508c4992c2 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.204345:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788179139.204382:0:6589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006daf256f/0xaa4c98508c4992c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.204392:0:6589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006daf256f/0xaa4c98508c4992c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179139.204401:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b611500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2356:x1875041451042560:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 204us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179139.204408:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 58 00010000:00010000:3.0:1788179139.204415:0:6589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006daf256f/0xaa4c98508c4992c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.204441:0:6589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006daf256f/0xaa4c98508c4992c2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.204449:0:6589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006daf256f/0xaa4c98508c4992c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.204456:0:6589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4600 already unused, calling callback (ffffffffc1644220) 00010000:00010000:3.0:1788179139.204461:0:6589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006daf256f/0xaa4c98508c4992c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.204470:0:6589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006daf256f/0xaa4c98508c4992c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.204483:0:6589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006daf256f/0xaa4c98508c4992c2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.204489:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006daf256f/0xaa4c98508c4992c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179139.204534:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2356:x1875041451042432:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 Request processed in 5010us (5168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179139.204542:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:2.0:1788179139.206659:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179139.206699:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451042816 00000100:00100000:3.0:1788179139.206710:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451042816 00000100:00100000:3.0:1788179139.206768:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 127 00000100:00100000:3.0:1788179139.206935:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+14:10516:x1875041451042816:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788179139.207010:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c4992c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.207028:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c4992c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.207039:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c4992c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.207362:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c4992d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.207371:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499283 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662130 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.207377:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c4992d0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.207404:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499283 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662130 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.207414:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499283 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662130 expref: 15 pid: 5827 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179139.207433:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f878380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5827:1875041472025216:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788179139.207498:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9054b4600 going to sleep for 11 seconds 00000100:00100000:1.0:1788179139.209547:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179139.209625:0:11517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451042944 00000100:00100000:0.0:1788179139.209634:0:11517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451042944 00000100:00100000:3.0:1788179139.209668:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f878380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5827:1875041472025216:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788179139.209670:0:11517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499283 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662130 expref: 16 pid: 5827 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.209691:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c4992d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179139.209710:0:11517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 59 00000100:00100000:0.0:1788179139.209717:0:11517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+16:2357:x1875041451042944:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179139.209732:0:11517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179139.209738:0:11517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499283 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662130 expref: 16 pid: 5827 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.209750:0:11517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499283 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662130 expref: 16 pid: 5827 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.209770:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499283 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662130 expref: 16 pid: 5827 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.209795:0:11517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bc903340e00) 00010000:00010000:0.0:1788179139.209800:0:11517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c4992d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.209818:0:11517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c4992d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.209826:0:11517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c4992d0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.209895:0:11517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788179139.209935:0:5827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c4992d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179139.209939:0:11517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+15:2357:x1875041451042944:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 222us (398us total) trans 0 rc 0/0 00010000:00010000:3.0:1788179139.209943:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c4992d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179139.209947:0:11517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 59 00000001:00080000:3.0:1788179139.210125:0:5827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1788179139.211035:0:5827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1788179139.211082:0:5827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1788179139.211156:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f878380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:5827:1875041472025344:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788179139.211258:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179139.211316:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e8e8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788179139.211350:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472025344 00000100:00100000:1.0:1788179139.211355:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472025344 00000100:00100000:1.0:1788179139.211392:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788179139.211401:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f87b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5827:x1875041472025344:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788179139.211553:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f87b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5827:x1875041472025344:12345-0@lo:1000:mdt00_003.0 Request processed in 154us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179139.211559:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788179139.211657:0:5827:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1788179139.211662:0:5827:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:3.0:1788179139.211680:0:5827:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9bc907039180 x1875041472024704/t4294967309(4294967309) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788179155 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179139.211689:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f878380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:5827:1875041472025344:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788179139.212085:0:5827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1788179139.212133:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f878380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:5827:1875041472025472:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788179139.212162:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179139.212181:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e8e89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788179139.212199:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472025472 00000100:00100000:2.0:1788179139.212204:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472025472 00000100:00100000:2.0:1788179139.212239:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788179139.212247:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5827:x1875041472025472:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788179139.212378:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5827:x1875041472025472:12345-0@lo:1000:mdt00_003.0 Request processed in 131us (214us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788179139.212385:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788179139.212407:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f878380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:5827:1875041472025472:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788179139.212483:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c4992d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.212491:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c4992d0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.212505:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c4992d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.212510:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4800 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179139.212513:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c4992d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.212518:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c4992d0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.212530:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bc903340e00) 00010000:00010000:3.0:1788179139.212532:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788179139.212535:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c4992d0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.212539:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c4992d0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.212565:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c499213 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.212568:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c499213 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.212571:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c499213 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.212574:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92e12dc00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179139.212576:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c499213 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.212588:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c499213 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.212596:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:3.0:1788179139.212654:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788179139.212660:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c49921a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662114 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.212668:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c49921a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662114 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.212674:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c49921a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662114 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.212694:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c49921a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662114 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179139.212701:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f87bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5827:1875041472025600:192.168.202.2@tcp:105: 00000100:00100000:3.0:1788179139.212753:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e8e89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788179139.214775:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f87bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5827:1875041472025600:192.168.202.2@tcp:105: 00010000:00010000:3.0:1788179139.214800:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c499213 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.214810:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c499213 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.214838:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4992d7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.214898:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4992d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.214909:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4992d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.214920:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4992d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.214925:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4992d7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.214932:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4992d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.214938:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4600 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179139.214942:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4992d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.214947:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4992d7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.214955:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:3.0:1788179139.214957:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179139.214958:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4992d7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.214962:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4992d7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.214969:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c4992c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.214979:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c4992c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.214982:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c4992c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.214985:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4400 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179139.214987:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c4992c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.214990:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c4992c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.214995:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:3.0:1788179139.214996:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788179139.214998:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c4992c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179139.215000:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c4992c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179139.215188:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+18:10516:x1875041451042816:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 8339us (8538us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1788179139.215206:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 127 00000020:00080000:3.0:1788179139.215211:0:5827:0:(tgt_main.c:811:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788179139.215240:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788179139.215245:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788179139.215748:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788179139.215757:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788179139.216438:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179139.216484:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451043072 00000100:00100000:3.0:1788179139.216489:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451043072 00000100:00100000:3.0:1788179139.216523:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:3.0:1788179139.216529:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+18:10515:x1875041451043072:12345-192.168.202.2@tcp:49:lfs.0 00000100:00100000:3.0:1788179139.216651:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+18:10515:x1875041451043072:12345-192.168.202.2@tcp:49:lfs.0 Request processed in 121us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179139.216659:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:2.0:1788179139.219830:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179139.219912:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179139.219931:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451043328 00000100:00100000:1.0:1788179139.219941:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451043328 00000100:00100000:1.0:1788179139.220000:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 128 00000100:00100000:1.0:1788179139.220025:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+18:10515:x1875041451043328:12345-192.168.202.2@tcp:58:lfs.0 00000040:00080000:1.0:1788179139.220399:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788179139.220492:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+18:10515:x1875041451043328:12345-192.168.202.2@tcp:58:lfs.0 Request processed in 469us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179139.220500:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 128 00000100:00100000:0.0:1788179139.223368:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451043584 00000100:00100000:0.0:1788179139.223384:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451043584 00000100:00100000:0.0:1788179139.223462:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00100000:0.0:1788179139.223472:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9266fe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+18:10516:x1875041451043584:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788179139.224154:0:5799:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788179139.224256:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1788179139.224301:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c4992de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.224318:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c4992de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.224329:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c4992de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.224348:0:5799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c4992de lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.224355:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c4992de lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.224362:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c4992de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.224383:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788179139.224470:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9266fe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+20:10516:x1875041451043584:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 997us (4555us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788179139.224477:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 32 00000020:00080000:0.0:1788179139.224481:0:5799:0:(tgt_main.c:811:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788179139.224685:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788179139.224692:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c4992de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.224699:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317fc00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:1.0:1788179139.224703:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c4992de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.224711:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c4992de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.224723:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9bc9062cb000) 00010000:00010000:1.0:1788179139.224726:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788179139.224730:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c4992de lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.224736:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c4992de lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179139.224753:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179139.224754:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179139.224756:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788179139.250958:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179139.252712:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451043712 00000100:00100000:0.0:1788179139.252727:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451043712 00000100:00100000:0.0:1788179139.252796:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 129 00000100:00100000:0.0:1788179139.252803:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+20:10518:x1875041451043712:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788179139.252825:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179139.252846:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4992e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466214c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.252949:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4992ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.252960:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4992ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.252969:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4992ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.252992:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4992f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.252996:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4992f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.253000:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4992f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.253217:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c4992fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.253224:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499205 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466210d expref: 21 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.253230:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c4992fa lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.253255:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499205 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466210d expref: 21 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.253264:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499205 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466210d expref: 21 pid: 5797 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179139.253274:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b612d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1875041472025728:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788179139.253347:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9201453c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788179139.257672:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179139.257745:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451043968 00000100:00100000:1.0:1788179139.257754:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451043968 00000100:00100000:1.0:1788179139.257829:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:1.0:1788179139.257841:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+22:5569:x1875041451043968:12345-192.168.202.2@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788179139.257881:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b612d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5798:1875041472025728:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788179139.257911:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c4992fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179139.258535:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+23:5569:x1875041451043968:12345-192.168.202.2@tcp:35:ldlm_bl.0 Request processed in 694us (869us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788179139.258544:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:1.0:1788179139.260615:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179139.260744:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451044096 00000100:00100000:2.0:1788179139.260754:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451044096 00010000:00010000:2.0:1788179139.260968:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499205 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466210d expref: 23 pid: 5797 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179139.261007:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00100000:2.0:1788179139.261017:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90710ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+23:2357:x1875041451044096:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788179139.261145:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179139.261154:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499205 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466210d expref: 23 pid: 5797 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.261179:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499205 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466210d expref: 23 pid: 5797 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.261200:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499205 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466210d expref: 23 pid: 5797 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.261282:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:2.0:1788179139.261288:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c4992fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.261510:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c4992fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.261518:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c4992fa lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179139.261553:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788179139.261622:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90710ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+22:2357:x1875041451044096:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 606us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179139.261630:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 60 00010000:00010000:0.0:1788179139.261724:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c4992fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.261733:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c4992fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179139.261774:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788179139.261777:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788179139.261795:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c4992fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.261806:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c4992fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.261816:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4992ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.261822:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4992ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.261839:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4992ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.261844:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179139.261863:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4992ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.261883:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4992ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.261893:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:0.0:1788179139.261903:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179139.261907:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4992ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.261914:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4992ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.261926:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4992f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.261933:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4992f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.261938:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4992f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.261943:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317fa00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179139.261946:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4992f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.261952:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4992f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.261959:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9bc9062cb800) 00010000:00010000:0.0:1788179139.261961:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179139.261964:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4992f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.261969:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4992f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.262000:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4992e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466214c expref: 22 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.262170:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c4992fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466214c expref: 21 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179139.262179:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:0.0:1788179139.262182:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788179139.262184:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317fc00, rc 0) 00000100:00100000:0.0:1788179139.262213:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+21:10518:x1875041451043712:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 9409us (11265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179139.262220:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 129 00010000:00010000:3.0:1788179139.852729:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788179140.126416:0:11955:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788179140.126426:0:11955:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788179140.126478:0:11955:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788179140.126484:0:11955:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788179140.225065:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788179140.225075:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788179140.225122:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788179140.225129:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788179140.225291:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f7f1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1875041472025856:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788179140.225393:0:11535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93213be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788179140.239634:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179140.239778:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451044224 00000100:00100000:2.0:1788179140.239787:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451044224 00000100:00100000:2.0:1788179140.239880:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 130 00000100:00100000:2.0:1788179140.239892:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+22:10530:x1875041451044224:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788179140.239928:0:5796:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788179140.240035:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+22:10530:x1875041451044224:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 145us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179140.240057:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 130 00000100:00100000:3.0:1788179140.240873:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f7f1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1875041472025856:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788179140.244030:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179140.249376:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451044480 00000100:00100000:1.0:1788179140.249394:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451044480 00000100:00100000:1.0:1788179140.250912:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 131 00000100:00100000:1.0:1788179140.250930:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f87bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+21:10530:x1875041451044480:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788179140.250951:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179140.250972:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173000/0xaa4c98508c499301 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662153 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179140.251068:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499308 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179140.251082:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179140.251095:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788179140.251105:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788179140.251249:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173000/0xaa4c98508c499301 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662153 expref: 24 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179140.251449:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499308 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662153 expref: 23 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179140.251458:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:1.0:1788179140.251461:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788179140.251464:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc942173e00, rc 0) 00000100:00100000:1.0:1788179140.251542:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f87bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+23:10530:x1875041451044480:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 618us (7520us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788179140.251550:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 131 00000100:00100000:3.0:1788179140.265801:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179140.265845:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179140.265911:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451044864 00000100:00100000:3.0:1788179140.265920:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451044864 00000100:00100000:3.0:1788179140.265985:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:3.0:1788179140.265995:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f879880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+23:2356:x1875041451044864:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788179140.266010:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179140.266038:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499308 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662153 expref: 23 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179140.266058:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:3.0:1788179140.266063:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179140.266116:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f879880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+22:2356:x1875041451044864:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 123us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179140.266123:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:1.0:1788179140.266310:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451044736 00000100:00100000:1.0:1788179140.266316:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451044736 00000100:00100000:1.0:1788179140.266358:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 132 00000100:00100000:1.0:1788179140.266366:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f87b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+22:10530:x1875041451044736:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788179140.266449:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c499316 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179140.266465:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c499316 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179140.266475:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c499316 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179140.266676:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c499316 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179140.266684:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c499316 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179140.266708:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c499316 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179140.266714:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc942172400 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179140.266718:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c499316 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179140.266725:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c499316 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179140.266735:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:1.0:1788179140.266737:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788179140.266741:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c499316 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179140.266748:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c499316 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179140.266893:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f87b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+23:10530:x1875041451044736:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 526us (1100us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788179140.266900:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 132 00000040:00080000:3.0:1788179140.268641:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788179140.268650:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788179140.269164:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788179140.269173:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788179140.278393:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179140.285059:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451045120 00000100:00100000:2.0:1788179140.285071:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451045120 00000100:00100000:2.0:1788179140.285136:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:2.0:1788179140.285146:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+23:10530:x1875041451045120:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788179140.285397:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+24:10530:x1875041451045120:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 252us (7014us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788179140.285406:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 34 00010000:00010000:2.0:1788179140.864171:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788179141.312068:0:6811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 337375215937ns, next at 338375213613ns, rc = 0 00000100:00100000:1.0:1788179141.312092:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788179141.312113:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472025984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788179141.312179:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179141.312247:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472025984 00000100:00100000:1.0:1788179141.312254:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472025984 00000100:00100000:1.0:1788179141.312307:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788179141.312316:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875041472025984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788179141.312363:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788179141.312406:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875041472025984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179141.312486:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1788179141.312509:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788179141.312726:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472025984:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788179141.888097:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788179142.022063:0:12006:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788179142.022073:0:12006:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788179142.022124:0:12006:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788179142.022132:0:12006:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788179142.169386:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179142.175923:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451045376 00000100:00100000:3.0:1788179142.175936:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451045376 00000100:00100000:3.0:1788179142.176081:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 133 00000100:00100000:3.0:1788179142.176093:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+24:10550:x1875041451045376:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1788179142.176117:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179142.176140:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c49931d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466215a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179142.176244:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c499324 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179142.176259:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c499324 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179142.176272:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c499324 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179142.176284:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000100:00080000:1.0:1788179142.176509:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788179142.177920:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c49931d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466215a expref: 27 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179142.177947:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c499324 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466215a expref: 26 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179142.178031:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:3.0:1788179142.178035:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788179142.178039:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4400, rc 0) 00000100:00100000:3.0:1788179142.178115:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+26:10550:x1875041451045376:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 2024us (8738us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788179142.178133:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 133 00000100:00100000:1.0:1788179142.194505:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179142.203418:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451045504 00000100:00100000:3.0:1788179142.203432:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451045504 00000100:00100000:3.0:1788179142.203695:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 134 00000100:00100000:3.0:1788179142.203707:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+26:10550:x1875041451045504:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:3.0:1788179142.203786:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499332 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179142.203803:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179142.203814:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179142.203871:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179142.203879:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499332 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179142.203887:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499332 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179142.203893:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4800 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179142.203898:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499332 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179142.203905:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499332 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179142.203916:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:3.0:1788179142.203932:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788179142.203938:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499332 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179142.203944:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499332 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179142.204034:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+26:10550:x1875041451045504:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 329us (9535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179142.204041:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 134 00000100:00100000:2.0:1788179142.337348:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179142.338586:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451045632 00000100:00100000:1.0:1788179142.338600:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451045632 00000100:00100000:1.0:1788179142.338687:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00100000:1.0:1788179142.338698:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2356:x1875041451045632:12345-192.168.202.2@tcp:101:cat.0 00010000:00010000:1.0:1788179142.338716:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179142.338736:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ae5f542/0xaa4c98508c499339 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662161 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788179142.338774:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9572c2, atime: 0x6a9572c1, ctime: 0x6a9572c2, blocks: 0xb 00010000:00010000:1.0:1788179142.338793:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=338s v=(0 0) 00010000:00010000:1.0:1788179142.338799:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179142.338809:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ae5f542/0xaa4c98508c499339 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662161 expref: 7 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179142.338828:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000ae5f542/0xaa4c98508c499339 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662161 expref: 7 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179142.338877:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc942173000, rc 0) 00000100:00100000:1.0:1788179142.338950:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2356:x1875041451045632:12345-192.168.202.2@tcp:101:cat.0 Request processed in 253us (1612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179142.338957:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00080000:2.0:1788179142.341218:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788179142.341559:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f87a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472026112:0@lo:400:kworker.0 00000100:00100000:2.0:1788179142.341629:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179142.341683:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041472026624:0@lo:400:kworker.0 00000100:00100000:2.0:1788179142.341709:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179142.341732:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788179142.341738:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041472026240:0@lo:400:kworker.0 00000100:00100000:2.0:1788179142.341772:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179142.341787:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472026752:0@lo:400:kworker.0 00000100:00100000:2.0:1788179142.341809:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179142.342233:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472026112 00000100:00100000:3.0:1788179142.342241:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472026112 00000100:00100000:3.0:1788179142.342290:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1788179142.342298:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:3307:x1875041472026112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179142.342356:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:3307:x1875041472026112:12345-0@lo:400:kworker.0 Request processed in 59us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179142.342363:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1788179142.342410:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f87a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472026112:0@lo:400:kworker.0 00000100:00100000:3.0:1788179142.342434:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472026624 00000100:00100000:3.0:1788179142.342437:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472026624 00000100:00100000:3.0:1788179142.342468:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472026240 00000100:00100000:3.0:1788179142.342471:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472026240 00000100:00100000:3.0:1788179142.342489:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788179142.342496:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875041472026624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179142.342532:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875041472026624:12345-0@lo:400:kworker.0 Request processed in 36us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179142.342538:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788179142.342548:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788179142.342566:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041472026240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179142.342593:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041472026240:12345-0@lo:400:kworker.0 Request processed in 28us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179142.342598:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1788179142.342611:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788179142.342631:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041472026240:0@lo:400:kworker.0 00000100:00100000:3.0:1788179142.342639:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041472026624:0@lo:400:kworker.0 00000100:00100000:0.0:1788179142.342799:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472026496:0@lo:400:kworker.0 00000100:00100000:0.0:1788179142.342832:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179142.342891:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788179142.342897:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc90703b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875041472026368:0@lo:400:kworker.0 00000100:00100000:0.0:1788179142.342921:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179142.342948:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472026368 00000100:00100000:0.0:1788179142.342952:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472026368 00000100:00100000:0.0:1788179142.342981:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788179142.342995:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875041472026368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179142.343029:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875041472026368:12345-0@lo:400:kworker.0 Request processed in 35us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179142.343035:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:0.0:1788179142.343053:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788179142.343070:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc90703b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875041472026368:0@lo:400:kworker.0 00000100:00100000:1.0:1788179142.343877:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472026752 00000100:00100000:1.0:1788179142.343884:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472026752 00000100:00100000:1.0:1788179142.343923:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472026496 00000100:00100000:1.0:1788179142.343926:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472026496 00000100:00100000:1.0:1788179142.343944:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788179142.343950:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1875041472026752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179142.344001:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1875041472026752:12345-0@lo:400:kworker.0 Request processed in 51us (2190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179142.344007:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788179142.344018:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788179142.344023:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1875041472026496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179142.344049:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1875041472026496:12345-0@lo:400:kworker.0 Request processed in 26us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179142.344054:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788179142.344085:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472026496:0@lo:400:kworker.0 00000100:00100000:1.0:1788179142.344107:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472026752:0@lo:400:kworker.0 00000100:00080000:0.0:1788179142.345004:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788179142.350695:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179142.351527:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451045760 00000100:00100000:3.0:1788179142.351540:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451045760 00002000:00100000:3.0:1788179142.351598:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9bc9358fb800 x1875041451045760/t0(0) o3->334bb25c-6762-4beb-8a84-3a838cbc7e80@192.168.202.2@tcp:158/0 lens 488/0 e 0 to 0 dl 1788179153 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788179142.351610:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bc9358fb800 with x1875041451045760 ext(0->4095) 00002000:00010000:3.0:1788179142.351615:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bc9358fb800 00000100:00100000:3.0:1788179142.351652:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:3.0:1788179142.351662:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2354:x1875041451045760:12345-192.168.202.2@tcp:3:cat.0 00000100:00100000:3.0:1788179142.351942:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2354:x1875041451045760:12345-192.168.202.2@tcp:3:cat.0 Request processed in 280us (1254us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788179142.351949:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 3 00002000:00100000:3.0:1788179142.351956:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9bc9358fb800 x1875041451045760/t0(0) o3->334bb25c-6762-4beb-8a84-3a838cbc7e80@192.168.202.2@tcp:158/0 lens 488/4536 e 0 to 0 dl 1788179153 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788179142.351965:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bc9358fb800 with x1875041451045760 ext(0->4095) 00002000:00010000:3.0:1788179142.351968:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bc9358fb800 00000100:00100000:0.0:1788179142.848176:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788179142.848199:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472026880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788179142.848261:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179142.848595:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472026880 00000100:00100000:2.0:1788179142.848604:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472026880 00000100:00100000:2.0:1788179142.848658:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788179142.848668:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875041472026880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788179142.848716:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179142.848970:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875041472026880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 303us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179142.848978:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788179142.849079:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472026880:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788179142.912448:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788179143.397367:0:7496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:2.0:1788179143.397391:0:7496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000100:00100000:0.0:1788179143.821720:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179143.821769:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179143.821798:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179143.821818:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179143.821881:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179143.821909:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451046400 00000100:00100000:0.0:1788179143.821918:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451046400 00000100:00100000:0.0:1788179143.821978:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451046016 00000100:00100000:0.0:1788179143.821981:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451046016 00000100:00100000:0.0:1788179143.822005:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 140 00000100:00100000:0.0:1788179143.822015:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b68d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2355:x1875041451046400:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179143.822084:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b68d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2355:x1875041451046400:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 70us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179143.822091:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 140 00000100:00100000:0.0:1788179143.822111:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 141 00000100:00100000:0.0:1788179143.822123:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b68fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+26:2355:x1875041451046016:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179143.822148:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b68fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+26:2355:x1875041451046016:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 26us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179143.822154:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 141 00000100:00080000:0.0:1788179143.822175:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788179143.822365:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451046144 00000100:00100000:1.0:1788179143.822370:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451046144 00000100:00100000:1.0:1788179143.822396:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451046272 00000100:00100000:1.0:1788179143.822399:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451046272 00000100:00100000:1.0:1788179143.822482:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 80 00000100:00100000:1.0:1788179143.822490:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90703b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2355:x1875041451046144:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179143.822639:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90703b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2355:x1875041451046144:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 36us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179143.822653:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 80 00000100:00100000:1.0:1788179143.822666:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 81 00000100:00100000:1.0:1788179143.822672:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2355:x1875041451046272:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179143.822697:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2355:x1875041451046272:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 26us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179143.822703:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 81 00000100:00080000:1.0:1788179143.822747:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788179143.823240:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451045888 00000100:00100000:3.0:1788179143.823248:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451045888 00000100:00100000:3.0:1788179143.823335:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 291 00000100:00100000:3.0:1788179143.823343:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2355:x1875041451045888:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788179143.823383:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2355:x1875041451045888:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 41us (1673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179143.823389:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 291 00010000:00010000:3.0:1788179143.936945:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788179144.437632:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1788179144.451012:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967408 is committed 00000004:00080000:0.0:1788179144.451033:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:0.0:1788179144.451054:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000001:00080000:0.0:1788179144.451065:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000001:00080000:0.0:1788179144.451072:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1788179144.451084:0:5818:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bc92e8e8cc0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788179144.451089:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9bc9054ff200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bc92e8e8c00 00000020:00080000:0.0:1788179144.451092:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9bc9054ff100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bc905189c00 00000020:00080000:0.0:1788179144.451117:0:5818:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1788179144.451123:0:5818:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 2 batchid updated 00000020:00080000:0.0:1788179144.451138:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000100:00100000:2.0:1788179144.451139:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472027008:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788179144.451318:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788179144.451367:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1788179144.454474:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472027008 00000100:00100000:1.0:1788179144.454487:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472027008 00000100:00100000:1.0:1788179144.454598:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788179144.454610:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1875041472027008:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788179144.454934:0:7778:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788179144.454939:0:7778:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788179138 -> 1788179138 00002000:00010000:1.0:1788179144.454941:0:7778:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 1788179137 -> 1788179137 00002000:00010000:1.0:1788179144.454943:0:7778:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788179138 -> 1788179138 00002000:00010000:1.0:1788179144.454945:0:7778:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788179144.455027:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1875041472027008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 420us (3710us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788179144.455035:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788179144.455217:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1788179144.455223:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bc907039180, transno 4294967309 00000004:00080000:2.0:1788179144.455239:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:2.0:1788179144.455261:0:3306:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9bc9358f9c00 x1875041472027008/t4294967312(4294967312) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788179160 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788179144.455272:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bc9358f9c00/2, rc 0, transno 4294967312 00000100:00100000:2.0:1788179144.455277:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472027008:0@lo:2:osp-syn-0-0.0 00000001:00080000:2.0:1788179144.456015:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00080000:0.0:1788179144.458481:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788179144.960129:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179145.984274:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179146.433931:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472027136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788179146.434019:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179146.435946:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472027136 00000100:00100000:3.0:1788179146.435958:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472027136 00000100:00100000:3.0:1788179146.436062:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788179146.436073:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875041472027136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788179146.436181:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788179146.436264:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875041472027136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 193us (2244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179146.436272:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788179146.436330:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472027136:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788179146.441338:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788179146.441347:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788179146.441640:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1788179146.441648:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00080000:0.0:1788179146.443094:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788179146.851944:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179146.852249:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451046528 00000100:00100000:2.0:1788179146.852259:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451046528 00000100:00100000:2.0:1788179146.852353:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 135 00000100:00100000:2.0:1788179146.852364:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+13:10195:x1875041451046528:12345-192.168.202.2@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788179146.852536:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+13:10195:x1875041451046528:12345-192.168.202.2@tcp:60:lhsmtool_posix.0 Request processed in 174us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179146.852543:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 135 00000100:00080000:1.0:1788179146.853176:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788179146.875499:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179146.875978:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451046784 00000100:00100000:0.0:1788179146.875991:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451046784 00000100:00100000:0.0:1788179146.876061:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:0.0:1788179146.876072:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+13:10195:x1875041451046784:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788179146.882123:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+14:10195:x1875041451046784:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 6040us (6621us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788179146.882138:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 35 00010000:00010000:1.0:1788179147.009164:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179147.163370:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179147.163622:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451046912 00000100:00100000:0.0:1788179147.163633:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451046912 00000100:00100000:0.0:1788179147.163778:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 136 00000100:00080000:1.0:1788179147.163886:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788179147.163906:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:11003:x1875041451046912:12345-192.168.202.2@tcp:101:lsof.0 00010000:00010000:0.0:1788179147.163931:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179147.163952:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499340 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662168 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179147.164016:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499347 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179147.164030:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499347 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179147.164041:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499347 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179147.164283:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788179147.164288:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788179147.164377:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499347 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179147.164404:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499340 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662168 expref: 7 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179147.164421:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499347 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662168 expref: 6 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179147.164444:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc9062cb300) 00010000:00010000:0.0:1788179147.164447:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788179147.164450:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317f200, rc 0) 00000100:00100000:0.0:1788179147.164505:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:176e2bf4-b5b0-4c8a-ad1b-45962a669671+6:11003:x1875041451046912:12345-192.168.202.2@tcp:101:lsof.0 Request processed in 613us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179147.164519:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 136 00000100:00100000:0.0:1788179147.457270:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041472027264:0@lo:400:kworker.0 00000100:00100000:0.0:1788179147.457352:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179147.457397:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472027648:0@lo:400:kworker.0 00000100:00100000:0.0:1788179147.457414:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041472027776:0@lo:400:kworker.0 00000100:00100000:3.0:1788179147.457437:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179147.457451:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179147.457570:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472027264 00000100:00100000:2.0:1788179147.457727:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc907039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041472027392:0@lo:400:kworker.0 00000100:00100000:2.0:1788179147.457762:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179147.457827:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472027904:0@lo:400:kworker.0 00000100:00100000:1.0:1788179147.457846:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472027264 00000100:00100000:0.0:1788179147.457876:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472027776 00000100:00100000:2.0:1788179147.457880:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179147.457882:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472027776 00000100:00100000:2.0:1788179147.457899:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788179147.457905:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041472027520:0@lo:400:kworker.0 00000100:00100000:1.0:1788179147.457925:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788179147.457927:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472027392 00000100:00100000:2.0:1788179147.457930:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179147.457931:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472027392 00000100:00100000:1.0:1788179147.457941:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+19:3308:x1875041472027264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179147.457946:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472027520 00000100:00100000:0.0:1788179147.457950:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472027520 00000100:00100000:2.0:1788179147.457963:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788179147.458001:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+19:3308:x1875041472027264:12345-0@lo:400:kworker.0 Request processed in 64us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179147.458009:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788179147.458024:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472027648 00000100:00100000:3.0:1788179147.458029:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472027648 00000100:00100000:3.0:1788179147.458056:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472027904 00000100:00100000:3.0:1788179147.458059:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472027904 00000100:00100000:3.0:1788179147.458094:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788179147.458102:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875041472027648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179147.458123:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788179147.458132:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472027904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179147.458167:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875041472027648:12345-0@lo:400:kworker.0 Request processed in 65us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179147.458176:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788179147.458188:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472027904:12345-0@lo:400:kworker.0 Request processed in 56us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179147.458196:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788179147.458222:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472027648:0@lo:400:kworker.0 00000100:00080000:1.0:1788179147.458291:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788179147.458296:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788179147.458317:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041472027264:0@lo:400:kworker.0 00000100:00100000:2.0:1788179147.458379:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906224380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041472027776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179147.458422:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788179147.458428:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1788179147.458444:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bc93f879180, transno 4294967304 00000100:00100000:3.0:1788179147.458456:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472027904:0@lo:400:kworker.0 00000100:00100000:2.0:1788179147.461254:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906224380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041472027776:12345-0@lo:400:kworker.0 Request processed in 3272us (3791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179147.464656:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788179147.464680:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041472027392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179147.464809:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041472027392:12345-0@lo:400:kworker.0 Request processed in 141us (7045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179147.464816:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788179147.464839:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788179147.464861:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041472027520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179147.464896:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041472027520:12345-0@lo:400:kworker.0 Request processed in 50us (6967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179147.464902:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788179147.464958:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041472027520:0@lo:400:kworker.0 00000100:00100000:0.0:1788179147.464973:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc907039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041472027392:0@lo:400:kworker.0 00000100:00100000:0.0:1788179147.465040:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041472027776:0@lo:400:kworker.0 00000100:00100000:2.0:1788179147.470942:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788179147.968807:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472028032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788179147.968896:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179147.969021:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472028032 00000100:00100000:2.0:1788179147.969029:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472028032 00000100:00100000:2.0:1788179147.969083:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788179147.969092:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472028032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788179147.969228:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179147.969289:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472028032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 198us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179147.969297:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788179147.969371:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472028032:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788179148.032430:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179148.944947:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179148.944989:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179148.945023:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179148.945116:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451047296 00000100:00100000:1.0:1788179148.945126:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451047296 00000100:00100000:1.0:1788179148.945200:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 84 00000100:00100000:1.0:1788179148.945211:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2354:x1875041451047296:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179148.945283:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2354:x1875041451047296:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 74us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179148.945290:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 84 00000100:00100000:2.0:1788179148.945368:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451047552 00000100:00100000:2.0:1788179148.945373:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451047552 00000100:00100000:2.0:1788179148.945409:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 145 00000100:00100000:2.0:1788179148.945416:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:176e2bf4-b5b0-4c8a-ad1b-45962a669671+6:2354:x1875041451047552:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788179148.945448:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:176e2bf4-b5b0-4c8a-ad1b-45962a669671+6:2354:x1875041451047552:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 33us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179148.945455:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 145 00000100:00080000:0.0:1788179148.945541:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788179148.945643:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451047040 00000100:00100000:3.0:1788179148.945648:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451047040 00000100:00100000:3.0:1788179148.945685:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 293 00000100:00100000:3.0:1788179148.945692:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2354:x1875041451047040:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788179148.945719:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2354:x1875041451047040:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 28us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179148.945726:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 293 00000100:00100000:3.0:1788179148.946286:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179148.946321:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179148.946383:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451047424 00000100:00100000:1.0:1788179148.946388:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451047424 00000100:00100000:1.0:1788179148.946439:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 85 00000100:00100000:1.0:1788179148.946447:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2354:x1875041451047424:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179148.946481:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2354:x1875041451047424:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 36us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179148.946502:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 85 00000100:00080000:2.0:1788179148.946573:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788179148.947006:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451047168 00000100:00100000:0.0:1788179148.947012:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451047168 00000100:00100000:0.0:1788179148.947060:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 146 00000100:00100000:0.0:1788179148.947068:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b68f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+14:2354:x1875041451047168:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179148.947109:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b68f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+14:2354:x1875041451047168:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 43us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179148.947116:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 146 00000100:00080000:2.0:1788179148.947247:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788179149.056172:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788179149.579340:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:2.0:1788179149.581626:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1788179149.581640:0:5818:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788179149.581697:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788179149.581707:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1788179150.082015:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788179150.713239:0:12207:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 08:25:48 (1788179148) 00010000:00010000:1.0:1788179151.103987:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179151.552360:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788179151.552385:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472028160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788179151.552454:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179151.552646:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472028160 00000100:00100000:1.0:1788179151.552655:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472028160 00000100:00100000:1.0:1788179151.552721:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788179151.552731:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472028160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788179151.552778:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788179151.552837:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472028160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179151.552844:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788179151.552989:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1788179151.552994:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bc9358f9c00, transno 4294967312 00000100:00100000:0.0:1788179151.553015:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472028160:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788179151.553078:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788179151.693483:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179151.693587:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451047808 00000100:00100000:2.0:1788179151.693597:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451047808 00000100:00080000:0.0:1788179151.693734:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788179151.693841:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 137 00000100:00100000:2.0:1788179151.693883:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+13:11269:x1875041451047808:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788179151.694024:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179151.694091:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c49934e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466216f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179151.694168:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499355 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179151.694203:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499355 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179151.694215:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499355 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179151.694246:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c49935c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179151.694254:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c49935c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179151.694261:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c49935c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179151.695050:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499363 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179151.695063:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499363 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179151.695071:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499363 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179151.695081:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1788179151.695277:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499355 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179151.695285:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499355 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179151.695292:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499355 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179151.695305:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c4a00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179151.695309:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499355 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179151.695317:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499355 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179151.695330:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bc903312700) 00010000:00010000:2.0:1788179151.695333:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179151.695338:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499355 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179151.695344:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499355 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179151.695356:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c49935c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179151.695363:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c49935c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179151.695369:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c49935c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179151.695373:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5600 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179151.695376:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c49935c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179151.695382:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c49935c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179151.695400:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bc909481e00) 00010000:00010000:2.0:1788179151.695403:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179151.695406:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c49935c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179151.695412:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c49935c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179151.698405:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c49934e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466216f expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179151.698434:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499363 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466216f expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179151.698445:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bc903340c00) 00010000:00010000:2.0:1788179151.698448:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179151.698453:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c4600, rc 0) 00000100:00100000:2.0:1788179151.698543:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+15:11269:x1875041451047808:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 4691us (5069us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1788179151.698553:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 137 00000100:00100000:3.0:1788179151.710807:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179151.710882:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451047936 00000100:00100000:3.0:1788179151.710889:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179151.710900:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451047936 00000100:00100000:0.0:1788179151.710970:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 138 00000100:00100000:0.0:1788179151.710980:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+15:11269:x1875041451047936:12345-192.168.202.2@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788179151.710998:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451048064 00000100:00100000:2.0:1788179151.711004:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451048064 00000100:00100000:2.0:1788179151.711057:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:2.0:1788179151.711066:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f878380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+16:2355:x1875041451048064:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788179151.711078:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788179151.711080:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+16:11269:x1875041451047936:12345-192.168.202.2@tcp:59:lhsmtool_posix.0 Request processed in 100us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179151.711102:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 138 00010000:00010000:2.0:1788179151.711112:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499363 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466216f expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179151.711141:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bc903340c00) 00010000:00010000:2.0:1788179151.711146:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788179151.711167:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f878380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+14:2355:x1875041451048064:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 103us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179151.711174:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00010000:00010000:3.0:1788179152.128149:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788179152.578512:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93fcf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472028672:0@lo:400:kworker.0 00000100:00100000:2.0:1788179152.578592:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179152.578712:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788179152.578721:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93539ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472028288:0@lo:400:kworker.0 00000100:00100000:2.0:1788179152.578761:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179152.578869:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93fcf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041472028800:0@lo:400:kworker.0 00000100:00100000:2.0:1788179152.578896:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179152.578921:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93fcf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875041472028544:0@lo:400:kworker.0 00000100:00100000:2.0:1788179152.578941:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179152.578957:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788179152.578961:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93fcf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875041472028416:0@lo:400:kworker.0 00000100:00100000:2.0:1788179152.578977:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179152.578989:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93fcf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472028928:0@lo:400:kworker.0 00000100:00100000:2.0:1788179152.579004:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788179152.579306:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788179152.579312:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1788179152.579902:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472028800 00000100:00100000:2.0:1788179152.579912:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472028800 00000100:00100000:2.0:1788179152.579966:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472028544 00000100:00100000:2.0:1788179152.579969:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472028544 00000100:00100000:2.0:1788179152.579985:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472028416 00000100:00100000:2.0:1788179152.579988:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472028416 00000100:00100000:2.0:1788179152.580020:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788179152.580030:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fcf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875041472028800:12345-0@lo:400:kworker.0 00000040:00080000:1.0:1788179152.580245:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788179152.580254:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788179152.580309:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472028672 00000100:00100000:1.0:1788179152.580313:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472028672 00000100:00100000:1.0:1788179152.580336:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472028928 00000100:00100000:1.0:1788179152.580339:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472028928 00000100:00100000:1.0:1788179152.580358:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788179152.580364:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fcf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472028672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179152.580473:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788179152.580481:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fcf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875041472028544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179152.580563:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fcf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472028672:12345-0@lo:400:kworker.0 Request processed in 198us (1971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179152.580571:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788179152.580587:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788179152.580592:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fcf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472028928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179152.580638:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fcf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472028928:12345-0@lo:400:kworker.0 Request processed in 45us (1631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179152.580644:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788179152.580674:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472028288 00000100:00100000:1.0:1788179152.580677:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472028288 00000100:00100000:1.0:1788179152.580702:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788179152.580709:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:3307:x1875041472028288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179152.580753:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:3307:x1875041472028288:12345-0@lo:400:kworker.0 Request processed in 44us (1990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179152.580759:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788179152.580799:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788179152.580805:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1788179152.580931:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93fcf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472028928:0@lo:400:kworker.0 00000100:00100000:1.0:1788179152.580958:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93539ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472028288:0@lo:400:kworker.0 00000100:00100000:1.0:1788179152.580969:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93fcf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472028672:0@lo:400:kworker.0 00000100:00100000:1.0:1788179152.581117:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788179152.581123:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fcf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875041472028416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179152.581156:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fcf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875041472028416:12345-0@lo:400:kworker.0 Request processed in 34us (2178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179152.581162:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788179152.581187:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93fcf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875041472028416:0@lo:400:kworker.0 00000100:00080000:1.0:1788179152.581294:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788179152.581299:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788179152.582775:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fcf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875041472028544:12345-0@lo:400:kworker.0 Request processed in 2287us (3824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179152.582795:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788179152.582912:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93fcf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875041472028544:0@lo:400:kworker.0 00000100:00100000:2.0:1788179152.583326:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fcf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875041472028800:12345-0@lo:400:kworker.0 Request processed in 3296us (4427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179152.583334:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788179152.583500:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93fcf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041472028800:0@lo:400:kworker.0 00000100:00100000:1.0:1788179153.089068:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f87a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472029056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788179153.089148:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179153.089340:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472029056 00000100:00100000:3.0:1788179153.089348:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472029056 00000100:00100000:3.0:1788179153.089398:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788179153.089408:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472029056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788179153.089443:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788179153.089487:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472029056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179153.089494:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788179153.089833:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f87a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472029056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788179153.145505:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179153.145582:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451048192 00000100:00100000:1.0:1788179153.145594:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451048192 00000100:00100000:1.0:1788179153.145680:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 139 00000100:00100000:1.0:1788179153.145692:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f87a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+14:11311:x1875041451048192:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788179153.145713:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179153.145801:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172200/0xaa4c98508c499371 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662176 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.145900:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c499378 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.145914:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c499378 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.145926:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c499378 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.145941:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c49937f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.145947:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c49937f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.145954:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c49937f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.146358:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c499378 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.146377:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c499378 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.146383:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c499378 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.146389:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc942172e00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179153.146393:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c499378 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.146400:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c499378 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.146411:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc9062cb300) 00010000:00010000:1.0:1788179153.146414:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179153.146419:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c499378 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.147418:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c499378 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.147438:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c49937f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.147444:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c49937f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.147450:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c49937f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.147454:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc942172400 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179153.147468:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c49937f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.147474:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c49937f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.147485:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9bc920ca7e00) 00010000:00010000:1.0:1788179153.147488:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179153.147491:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c49937f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.147497:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c49937f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.147538:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172200/0xaa4c98508c499371 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662176 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.147548:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc9062cb300) 00010000:00010000:1.0:1788179153.147550:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179153.147554:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172200/0xaa4c98508c499371 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662176 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.147564:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc942172200, rc 0) 00000100:00100000:1.0:1788179153.147635:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f87a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+14:11311:x1875041451048192:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 1945us (2139us total) trans 0 rc 301/301 00000100:00080000:3.0:1788179153.148169:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788179153.148215:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 139 00000100:00100000:2.0:1788179153.152908:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00010000:00010000:2.0:1788179153.152971:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179153.153190:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451048448 00000100:00100000:3.0:1788179153.153202:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451048448 00000100:00100000:3.0:1788179153.153251:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 140 00000100:00100000:3.0:1788179153.153262:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fcf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+14:11311:x1875041451048448:12345-192.168.202.2@tcp:36:lfs.0 00010000:00010000:3.0:1788179153.153315:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179153.153339:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc900030a00/0xaa4c98508c498cef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661faf expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.153356:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc9062cb300) 00010000:00010000:3.0:1788179153.153361:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788179153.153626:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c499386 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.153640:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499347 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662168 expref: 5 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.153662:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c499386 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.153703:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499347 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662168 expref: 5 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.153717:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499347 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662168 expref: 5 pid: 5798 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179153.153732:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9359b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1875041472029184:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788179153.154023:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93fadc180 going to sleep for 11 seconds 00000100:00100000:0.0:1788179153.158364:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9359b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1875041472029184:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788179153.158396:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c499386 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179153.159954:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179153.160162:0:11517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451048576 00000100:00100000:0.0:1788179153.160171:0:11517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451048576 00010000:00010000:0.0:1788179153.160225:0:11517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499347 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662168 expref: 6 pid: 5798 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179153.160269:0:11517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:0.0:1788179153.160279:0:11517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fcf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:176e2bf4-b5b0-4c8a-ad1b-45962a669671+6:2356:x1875041451048576:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179153.160296:0:11517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179153.160303:0:11517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499347 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662168 expref: 6 pid: 5798 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.160316:0:11517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499347 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662168 expref: 6 pid: 5798 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.160351:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499347 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662168 expref: 6 pid: 5798 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.160366:0:11517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc9062cb300) 00010000:00010000:0.0:1788179153.160370:0:11517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c499386 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.160378:0:11517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c499386 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.160385:0:11517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c499386 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.160407:0:11517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179153.160471:0:11517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fcf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2356:x1875041451048576:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 193us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179153.160478:0:11517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 61 00010000:00010000:0.0:1788179153.160504:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c499386 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.160512:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c499386 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.160533:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c49938d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.160543:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c49938d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.160550:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c49938d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179153.164457:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1788179153.164479:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c499386 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.164490:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c499386 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.164498:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c499386 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.164504:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4600 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179153.164509:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c499386 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.164516:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c499386 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.164530:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc9062cb300) 00010000:00010000:0.0:1788179153.164533:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179153.164537:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c499386 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.164543:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c499386 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788179153.164561:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f02f0cfc reply state 00000000b7c25d9a transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c49938d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179153.164572:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00080000:3.0:1788179153.165203:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788179153.166004:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fcf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+15:11311:x1875041451048448:12345-192.168.202.2@tcp:36:lfs.0 Request processed in 12737us (13100us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1788179153.166024:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 140 00010000:00010000:0.0:1788179153.169940:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c49938d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.169959:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c49938d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.169967:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c49938d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.169974:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179153.169978:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c49938d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.169987:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c49938d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.170003:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9bc9062cb400) 00010000:00010000:0.0:1788179153.170007:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179153.170011:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c49938d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.170017:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c49938d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179153.212762:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179153.212900:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451048704 00000100:00100000:3.0:1788179153.212910:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451048704 00000100:00100000:3.0:1788179153.212964:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 141 00000100:00100000:3.0:1788179153.212975:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fcf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+14:11319:x1875041451048704:12345-192.168.202.2@tcp:101:lctl.0 00010000:00010000:3.0:1788179153.212997:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179153.213027:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499394 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466217d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.213105:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c49939b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.213119:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c49939b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.213130:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c49939b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179153.213185:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788179153.213190:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1788179153.213232:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c49939b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.213257:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499394 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466217d expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.213273:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c49939b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466217d expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.213282:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc903312a00) 00010000:00010000:3.0:1788179153.213285:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788179153.213289:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4e00, rc 0) 00000100:00100000:3.0:1788179153.213345:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fcf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+15:11319:x1875041451048704:12345-192.168.202.2@tcp:101:lctl.0 Request processed in 371us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179153.213352:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 141 00000100:00100000:3.0:1788179153.243350:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179153.248984:0:12275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451048832 00000100:00100000:1.0:1788179153.248996:0:12275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451048832 00000100:00100000:1.0:1788179153.249041:0:12275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 142 00000100:00100000:1.0:1788179153.249048:0:12275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+15:11325:x1875041451048832:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:1.0:1788179153.249070:0:12275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179153.249087:0:12275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172200/0xaa4c98508c4993a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662184 expref: -99 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.249137:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c4993a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.249147:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c4993a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.249156:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c4993a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.249164:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c4993b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.249168:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c4993b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.249172:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c4993b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.249258:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173c00/0xaa4c98508c4993b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.249265:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173c00/0xaa4c98508c4993b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.249271:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173c00/0xaa4c98508c4993b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788179153.249300:0:12275:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1788179153.249310:0:12275:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788179153.249336:0:12275:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173c00/0xaa4c98508c4993b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.249348:0:12275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c4993a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.249355:0:12275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c4993a9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.249362:0:12275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c4993a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.249367:0:12275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc942172400 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179153.249371:0:12275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c4993a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.249378:0:12275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c4993a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.249391:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc903312a00) 00010000:00010000:1.0:1788179153.249394:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179153.249399:0:12275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c4993a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.249404:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c4993a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.249412:0:12275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c4993b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.249415:0:12275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c4993b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.249426:0:12275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c4993b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.249429:0:12275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc942172e00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179153.249431:0:12275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c4993b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.249434:0:12275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c4993b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.249439:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9bc920ca7e00) 00010000:00010000:1.0:1788179153.249441:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179153.249443:0:12275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c4993b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.249446:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c4993b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.249466:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172200/0xaa4c98508c4993a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662184 expref: 17 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.249474:0:12275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173c00/0xaa4c98508c4993b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662184 expref: 16 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.249478:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:1.0:1788179153.249479:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788179153.249481:0:12275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc942173c00, rc 0) 00000100:00100000:1.0:1788179153.249540:0:12275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+16:11325:x1875041451048832:12345-192.168.202.2@tcp:101:bash.0 Request processed in 491us (6199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179153.249554:0:12275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 142 00000100:00100000:3.0:1788179153.258018:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179153.259939:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451049088 00000100:00100000:3.0:1788179153.259949:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451049088 00000100:00100000:3.0:1788179153.259993:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 143 00000100:00100000:3.0:1788179153.260000:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+16:11325:x1875041451049088:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:3.0:1788179153.260018:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179153.260034:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c4993be lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466218b expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.260146:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4993c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.260158:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4993c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.260172:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4993c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.260183:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4993cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.260188:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4993cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.260192:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4993cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788179153.260684:0:5797:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788179153.260884:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4993d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.260894:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4993d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.260901:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4993d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.260939:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4993c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.260948:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4993c5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.260954:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4993c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.260960:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179153.260972:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4993c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.260979:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4993c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.260990:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:3.0:1788179153.260993:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179153.260997:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4993c5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.261003:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4993c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788179153.261014:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d05e757b reply state 00000000e52666e7 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4993cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179153.261021:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788179153.261052:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c4993be lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466218b expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.261079:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4993d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466218b expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.261086:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312000) 00010000:00010000:3.0:1788179153.261088:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788179153.261091:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4600, rc 0) 00000100:00100000:3.0:1788179153.261164:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+19:11325:x1875041451049088:12345-192.168.202.2@tcp:101:bash.0 Request processed in 1164us (3151us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1788179153.261170:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 143 00010000:00010000:3.0:1788179153.263470:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4993cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.263484:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4993cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.263491:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4993cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.263497:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5e00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179153.263501:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4993cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.263508:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4993cc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.263522:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bc903312d00) 00010000:00010000:3.0:1788179153.263525:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179153.263542:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4993cc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.263549:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4993cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179153.265400:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179153.265460:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451049216 00000100:00100000:0.0:1788179153.265470:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451049216 00000100:00080000:3.0:1788179153.265559:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788179153.265589:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:0.0:1788179153.265601:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2356:x1875041451049216:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1788179153.265618:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179153.265643:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce65c721/0xaa4c98508c4993e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662192 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788179153.265670:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788179153.265688:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=349s v=(0 0) 00010000:00010000:0.0:1788179153.265693:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788179153.265702:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce65c721/0xaa4c98508c4993e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662192 expref: 6 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.265721:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ce65c721/0xaa4c98508c4993e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662192 expref: 6 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.265744:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317f200, rc 0) 00000100:00100000:0.0:1788179153.265887:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2356:x1875041451049216:12345-192.168.202.2@tcp:101:bash.0 Request processed in 288us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179153.265894:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:3.0:1788179153.267582:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179153.267887:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451049344 00000100:00100000:0.0:1788179153.267896:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451049344 00000100:00100000:0.0:1788179153.267945:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:0.0:1788179153.267956:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:11325:x1875041451049344:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1788179153.267972:0:7778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179153.267989:0:7778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001147547e/0xaa4c98508c4993e8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662199 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.268017:0:7778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce65c721/0xaa4c98508c4993e1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662192 expref: 7 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.268037:0:7778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788179153.268042:0:7778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788179153.268048:0:7778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001147547e/0xaa4c98508c4993e8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662199 expref: 7 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.268084:0:7778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ce65c721/0xaa4c98508c4993e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662192 expref: 7 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.268099:0:7778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ce65c721/0xaa4c98508c4993e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662192 expref: 7 pid: 6589 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179153.268113:0:7778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f82c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7778:1875041472029312:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788179153.268205:0:7778:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc8013bfc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788179153.271595:0:7778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f82c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7778:1875041472029312:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788179153.271634:0:7778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001147547e/0xaa4c98508c4993e8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662199 expref: 7 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.271655:0:7778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317f000, rc 0) 00000100:00100000:1.0:1788179153.271721:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:11325:x1875041451049344:12345-192.168.202.2@tcp:101:bash.0 Request processed in 3766us (4146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179153.271730:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:1.0:1788179153.272560:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179153.272616:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451049472 00000100:00100000:2.0:1788179153.272624:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451049472 00010000:00010000:2.0:1788179153.272660:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ce65c721/0xaa4c98508c4993e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662192 expref: 7 pid: 6589 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179153.272696:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 62 00000100:00100000:2.0:1788179153.272706:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2357:x1875041451049472:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788179153.272721:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179153.272753:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ce65c721/0xaa4c98508c4993e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662192 expref: 7 pid: 6589 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.272768:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ce65c721/0xaa4c98508c4993e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662192 expref: 7 pid: 6589 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.272791:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce65c721/0xaa4c98508c4993e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662192 expref: 7 pid: 6589 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.272822:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179153.272826:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179153.272834:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001147547e/0xaa4c98508c4993e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662199 expref: 6 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.272844:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001147547e/0xaa4c98508c4993e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662199 expref: 6 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.272906:0:5783:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001147547e/0xaa4c98508c4993e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662199 expref: 6 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179153.272919:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93fcf5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5783:1875041472029440:192.168.202.2@tcp:105: 00000100:00100000:2.0:1788179153.272985:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e8e8480 going to sleep for 11 seconds 00000100:00100000:2.0:1788179153.276400:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179153.276545:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451049728 00000100:00100000:2.0:1788179153.276554:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451049728 00000100:00100000:2.0:1788179153.276605:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:2.0:1788179153.276615:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fcf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+18:11325:x1875041451049728:12345-192.168.202.2@tcp:35:bash.0 00000100:00100000:2.0:1788179153.277161:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fcf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+19:11325:x1875041451049728:12345-192.168.202.2@tcp:35:bash.0 Request processed in 547us (770us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788179153.277169:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:0.0:1788179153.277425:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93fcf5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5783:1875041472029440:192.168.202.2@tcp:105: 00010000:00010000:0.0:1788179153.277448:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179153.277471:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2357:x1875041451049472:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 4767us (4914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179153.277479:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 62 00000100:00100000:2.0:1788179153.318173:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179153.318278:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451049984 00000100:00100000:1.0:1788179153.318289:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451049984 00000100:00100000:1.0:1788179153.318349:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 144 00000100:00100000:1.0:1788179153.318359:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fcf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+19:11335:x1875041451049984:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788179153.318384:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179153.318404:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c4993ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746621a0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788179153.318519:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1788179153.318612:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c4993ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621a0 expref: 21 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.318623:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc903312a00) 00010000:00010000:1.0:1788179153.318626:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788179153.318629:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c4993ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621a0 expref: 21 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.318659:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc942172e00, rc 0) 00000100:00100000:1.0:1788179153.318717:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fcf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+20:11335:x1875041451049984:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 359us (554us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1788179153.318725:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 144 00000100:00100000:0.0:1788179153.323467:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179153.323556:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451050240 00000100:00100000:3.0:1788179153.323567:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451050240 00000100:00100000:3.0:1788179153.323660:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 37 00000100:00100000:3.0:1788179153.323672:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f82c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+20:11335:x1875041451050240:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:3.0:1788179153.324043:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f82c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+21:11335:x1875041451050240:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 372us (583us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788179153.324051:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 37 00000100:00100000:2.0:1788179153.370709:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179153.370782:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451050368 00000100:00100000:0.0:1788179153.370792:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451050368 00000100:00100000:0.0:1788179153.370930:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 145 00000100:00100000:0.0:1788179153.370942:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fcf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+21:11341:x1875041451050368:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788179153.370966:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179153.371003:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4993fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746621a7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.371072:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499404 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.371086:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499404 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.371098:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499404 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179153.371158:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1788179153.371162:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788179153.371186:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499404 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.371215:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4993fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621a7 expref: 23 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.371235:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499404 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621a7 expref: 22 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.371243:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:0.0:1788179153.371247:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788179153.371251:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317e200, rc 0) 00000100:00100000:0.0:1788179153.371307:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fcf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+22:11341:x1875041451050368:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 366us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179153.371314:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 145 00000100:00100000:2.0:1788179153.375471:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179153.377241:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451050624 00000100:00100000:3.0:1788179153.377257:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451050624 00000100:00100000:3.0:1788179153.377332:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 146 00000100:00100000:3.0:1788179153.377343:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fcf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+22:11341:x1875041451050624:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1788179153.377364:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179153.377385:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c49940b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746621ae expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.377484:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499412 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.377499:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4993d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466218b expref: 23 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.377508:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499412 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.377573:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4993d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466218b expref: 23 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.377590:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4993d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466218b expref: 23 pid: 5797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179153.377604:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e6bea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1875041472029568:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788179153.378065:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93fadcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788179153.382822:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e6bea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1875041472029568:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788179153.382885:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499412 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179153.383065:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179153.383369:0:11517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451050752 00000100:00100000:0.0:1788179153.383395:0:11517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451050752 00010000:00010000:0.0:1788179153.383431:0:11517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4993d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466218b expref: 24 pid: 5797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179153.383507:0:11517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00100000:0.0:1788179153.383517:0:11517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fcf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+24:2357:x1875041451050752:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179153.383532:0:11517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179153.383539:0:11517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4993d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466218b expref: 24 pid: 5797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.383550:0:11517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4993d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466218b expref: 24 pid: 5797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.383583:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4993d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466218b expref: 24 pid: 5797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.383598:0:11517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312000) 00010000:00010000:0.0:1788179153.383603:0:11517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499412 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.383612:0:11517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499412 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.383619:0:11517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499412 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.383653:0:11517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179153.383711:0:11517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fcf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+23:2357:x1875041451050752:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 195us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179153.383727:0:11517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 63 00010000:00010000:3.0:1788179153.384016:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499412 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.384025:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499412 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179153.384041:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788179153.384191:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c49940b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621ae expref: 24 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.384207:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499412 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621ae expref: 23 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.384214:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312000) 00010000:00010000:3.0:1788179153.384217:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788179153.384219:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4800, rc 0) 00000100:00100000:3.0:1788179153.384247:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fcf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+23:11341:x1875041451050624:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 6907us (8787us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1788179153.384254:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 146 00000100:00100000:2.0:1788179153.389665:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179153.393280:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451051008 00000100:00100000:1.0:1788179153.393295:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451051008 00000100:00100000:1.0:1788179153.393494:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 147 00000100:00100000:1.0:1788179153.393505:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fcf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+23:11341:x1875041451051008:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788179153.393542:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179153.393546:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788179153.393575:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499412 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621ae expref: 23 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.393594:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312000) 00010000:00010000:1.0:1788179153.393604:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788179153.393618:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172200/0xaa4c98508c499420 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746621b5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.393808:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499427 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.393822:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499427 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.393832:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499427 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788179153.393966:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788179153.394155:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172200/0xaa4c98508c499420 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621b5 expref: 25 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.394172:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499427 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621b5 expref: 24 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.394179:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc920ca7e00) 00010000:00010000:1.0:1788179153.394181:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788179153.394184:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc942173e00, rc 0) 00000100:00100000:1.0:1788179153.394294:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fcf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+24:11341:x1875041451051008:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 790us (4647us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1788179153.394302:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 147 00000100:00100000:1.0:1788179153.398591:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179153.399743:0:12275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451051136 00000100:00100000:3.0:1788179153.399758:0:12275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451051136 00000100:00100000:3.0:1788179153.399822:0:12275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 148 00000100:00100000:3.0:1788179153.399844:0:12275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+24:11341:x1875041451051136:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1788179153.399922:0:12275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179153.399942:0:12275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499435 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746621bc expref: -99 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.400409:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499435 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621bc expref: 25 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.400425:0:12275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499435 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621bc expref: 25 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.400443:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc920ca7e00) 00010000:00010000:2.0:1788179153.400446:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788179153.400450:0:12275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b5e00, rc 0) 00000100:00100000:2.0:1788179153.400515:0:12275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+25:11341:x1875041451051136:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 684us (1933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179153.400522:0:12275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 148 00000100:00100000:2.0:1788179153.413304:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179153.413410:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451051264 00000100:00100000:0.0:1788179153.413420:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451051264 00000100:00100000:0.0:1788179153.413481:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:0.0:1788179153.413491:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fcf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2356:x1875041451051264:12345-192.168.202.2@tcp:1:lfs.0 00010000:00010000:0.0:1788179153.413546:0:6589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000993384da/0xaa4c98508c49943c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.413567:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001147547e/0xaa4c98508c4993e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662199 expref: 6 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.413576:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788179153.413580:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788179153.413585:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000993384da/0xaa4c98508c49943c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.413620:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001147547e/0xaa4c98508c4993e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662199 expref: 6 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.413633:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001147547e/0xaa4c98508c4993e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662199 expref: 6 pid: 7778 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179153.413658:0:6589:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f82c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6589:1875041472029696:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788179153.413750:0:6589:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc8013bff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788179153.417155:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179153.417250:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451051392 00000100:00100000:3.0:1788179153.417259:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451051392 00002000:00100000:3.0:1788179153.417307:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9bc90121a680 x1875041451051392/t0(0) o4->334bb25c-6762-4beb-8a84-3a838cbc7e80@192.168.202.2@tcp:169/0 lens 504/0 e 0 to 0 dl 1788179164 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788179153.417319:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bc90121a680 with x1875041451051392 ext(0->12) 00010000:00010000:3.0:1788179153.417329:0:6595:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001147547e/0xaa4c98508c4993e8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662199 expref: 7 pid: 7778 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.417345:0:6595:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001147547e/0xaa4c98508c4993e8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662199 expref: 7 pid: 7778 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788179153.417351:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bc90121a680 00000100:00100000:3.0:1788179153.417384:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:3.0:1788179153.417394:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90121a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2356:x1875041451051392:12345-192.168.202.2@tcp:4:lfs.0 00000100:00100000:3.0:1788179153.417924:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90121a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+9:2356:x1875041451051392:12345-192.168.202.2@tcp:4:lfs.0 Request processed in 530us (778us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788179153.417933:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 2 00002000:00100000:3.0:1788179153.417939:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9bc90121a680 x1875041451051392/t4294967305(0) o4->334bb25c-6762-4beb-8a84-3a838cbc7e80@192.168.202.2@tcp:169/0 lens 504/448 e 0 to 0 dl 1788179164 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788179153.417948:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bc90121a680 with x1875041451051392 ext(0->12) 00010000:00010000:3.0:1788179153.417953:0:6595:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001147547e/0xaa4c98508c4993e8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662199 expref: 9 pid: 7778 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.417969:0:6595:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001147547e/0xaa4c98508c4993e8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662199 expref: 9 pid: 7778 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788179153.417977:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bc90121a680 00000100:00100000:1.0:1788179153.419976:0:6589:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f82c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6589:1875041472029696:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788179153.420005:0:6589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000993384da/0xaa4c98508c49943c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179153.421784:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179153.421872:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451051520 00000100:00100000:1.0:1788179153.421881:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451051520 00010000:00010000:1.0:1788179153.421923:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001147547e/0xaa4c98508c4993e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662199 expref: 9 pid: 7778 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179153.422013:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 64 00000100:00100000:1.0:1788179153.422023:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fcf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+9:2357:x1875041451051520:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788179153.422053:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788179153.422082:0:5781:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788179153.422085:0:5781:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788179152 00002000:00010000:1.0:1788179153.422088:0:5781:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788179152 00002000:00010000:1.0:1788179153.422090:0:5781:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788179152 00010000:00010000:1.0:1788179153.422096:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001147547e/0xaa4c98508c4993e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662199 expref: 9 pid: 7778 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.422110:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001147547e/0xaa4c98508c4993e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662199 expref: 9 pid: 7778 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.422133:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001147547e/0xaa4c98508c4993e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662199 expref: 9 pid: 7778 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.422151:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788179153.422156:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788179153.422161:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000993384da/0xaa4c98508c49943c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.422172:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000993384da/0xaa4c98508c49943c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179153.422205:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788179153.422259:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fcf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2357:x1875041451051520:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 237us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179153.422267:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 64 00010000:00010000:2.0:1788179153.422801:0:6589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000993384da/0xaa4c98508c49943c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.422812:0:6589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000993384da/0xaa4c98508c49943c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.422836:0:6589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000993384da/0xaa4c98508c49943c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.422844:0:6589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000993384da/0xaa4c98508c49943c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.422904:0:6589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000993384da/0xaa4c98508c49943c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.422912:0:6589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f400 already unused, calling callback (ffffffffc1644220) 00010000:00010000:2.0:1788179153.422916:0:6589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000993384da/0xaa4c98508c49943c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.422925:0:6589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000993384da/0xaa4c98508c49943c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.422937:0:6589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000993384da/0xaa4c98508c49943c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.422944:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000993384da/0xaa4c98508c49943c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179153.423002:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fcf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2356:x1875041451051264:12345-192.168.202.2@tcp:1:lfs.0 Request processed in 9512us (9707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179153.423011:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:2.0:1788179153.425549:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179153.425680:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451051776 00000100:00100000:3.0:1788179153.425691:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451051776 00000100:00100000:3.0:1788179153.425752:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:3.0:1788179153.425762:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9266fd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+25:11341:x1875041451051776:12345-192.168.202.2@tcp:35:lfs.0 00000004:00010000:3.0:1788179153.425821:0:5799:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499427 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621b5 expref: 25 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788179153.426091:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1788179153.426134:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1788179153.426789:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1788179153.426846:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499443 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.426881:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499435 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621bc expref: 29 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.426892:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499443 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.426926:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499435 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621bc expref: 29 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.426941:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499435 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621bc expref: 29 pid: 12275 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179153.426963:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e6bea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5799:1875041472029824:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788179153.427048:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc803c6ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788179153.430889:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e6bea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5799:1875041472029824:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788179153.430920:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499443 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179153.431919:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179153.432085:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451051904 00000100:00100000:0.0:1788179153.432098:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451051904 00010000:00010000:0.0:1788179153.432133:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499435 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621bc expref: 30 pid: 12275 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179153.432171:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 65 00000100:00100000:0.0:1788179153.432180:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90710e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+30:2356:x1875041451051904:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179153.432194:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179153.432200:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499435 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621bc expref: 30 pid: 12275 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.432211:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499435 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621bc expref: 30 pid: 12275 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.432233:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499435 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621bc expref: 30 pid: 12275 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.432247:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc920ca7e00) 00010000:00010000:0.0:1788179153.432252:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499443 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.432260:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499443 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.432268:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499443 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.432296:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179153.432350:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90710e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+29:2356:x1875041451051904:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 170us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179153.432365:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 65 00010000:00010000:2.0:1788179153.433049:0:5799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499443 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.433071:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499443 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788179153.433196:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788179153.433382:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1788179153.433497:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93fcf7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1875041472029952:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788179153.433659:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179153.433724:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e8e8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788179153.434263:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472029952 00000100:00100000:1.0:1788179153.434271:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472029952 00000100:00100000:1.0:1788179153.434322:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788179153.434330:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fcf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5799:x1875041472029952:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788179153.434415:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fcf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5799:x1875041472029952:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 85us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179153.434662:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93fcf7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1875041472029952:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788179153.435389:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1788179153.435599:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e6be680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1875041472030080:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788179153.435695:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179153.435715:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc803c6f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788179153.435863:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788179153.435872:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1788179153.435971:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788179153.435993:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472030080 00000100:00100000:1.0:1788179153.435998:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472030080 00000100:00100000:1.0:1788179153.436022:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788179153.436030:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e6bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5799:x1875041472030080:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788179153.436199:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e6bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5799:x1875041472030080:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 168us (503us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788179153.436205:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788179153.436328:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e6be680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5799:1875041472030080:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788179153.436373:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1788179153.436405:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499443 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.436415:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499443 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.436434:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499443 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.436441:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179153.436446:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499443 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.436454:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499443 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.436469:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc920ca7e00) 00010000:00010000:2.0:1788179153.436480:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788179153.436485:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499443 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.436491:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499443 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788179153.436953:0:5799:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788179153.437059:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1788179153.437140:0:5799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 349500289801ns, next at 350500287242ns, rc = 0 00000001:00080000:2.0:1788179153.437147:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1788179153.437182:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc920ca7e00) 00010000:00010000:2.0:1788179153.437185:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788179153.437192:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499427 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621b5 expref: 33 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179153.437326:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9266fd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+32:11341:x1875041451051776:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 11565us (11784us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1788179153.437335:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 38 00000020:00080000:2.0:1788179153.437341:0:5799:0:(tgt_main.c:811:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788179153.444500:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179153.444765:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451052032 00000100:00100000:3.0:1788179153.444775:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451052032 00000100:00100000:3.0:1788179153.444835:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 149 00000100:00100000:3.0:1788179153.444845:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fcf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+32:11341:x1875041451052032:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1788179153.444904:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179153.444927:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c49944a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746621c3 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.444984:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c49944a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621c3 expref: 33 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.444998:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c49944a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621c3 expref: 33 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.445014:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312d00) 00010000:00010000:3.0:1788179153.445018:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788179153.445022:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b5200, rc 0) 00000100:00100000:3.0:1788179153.445084:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fcf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+33:11341:x1875041451052032:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 241us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179153.445103:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 149 00000100:00100000:0.0:1788179153.447742:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179153.447830:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451052288 00000100:00100000:2.0:1788179153.447839:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451052288 00000100:00100000:2.0:1788179153.447920:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:2.0:1788179153.447928:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc901219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+33:11341:x1875041451052288:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:2.0:1788179153.448170:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc901219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+34:11341:x1875041451052288:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 241us (445us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1788179153.448177:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:1.0:1788179153.530950:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179153.534256:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451052544 00000100:00100000:2.0:1788179153.534294:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451052544 00000100:00100000:2.0:1788179153.534382:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 150 00000100:00100000:2.0:1788179153.534395:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+34:11351:x1875041451052544:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788179153.534425:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179153.534464:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c499451 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746621ca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179153.535096:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1788179153.535229:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c499451 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621ca expref: 36 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.535245:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc903312a00) 00010000:00010000:2.0:1788179153.535247:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788179153.535253:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c499451 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621ca expref: 36 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.535267:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c5800, rc 0) 00000100:00100000:2.0:1788179153.535381:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+35:11351:x1875041451052544:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 988us (4441us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788179153.535389:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 150 00000100:00100000:1.0:1788179153.544328:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179153.544474:0:12275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451052672 00000100:00100000:2.0:1788179153.544485:0:12275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451052672 00000100:00100000:2.0:1788179153.544543:0:12275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 151 00000100:00100000:2.0:1788179153.544554:0:12275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f82c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+35:11351:x1875041451052672:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:2.0:1788179153.544625:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49945f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.544651:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49945f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.544678:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49945f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.544693:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499466 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.544701:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.544707:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.544811:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c49946d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.544819:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c49946d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.544827:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c49946d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788179153.544906:0:12275:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c49946d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.544919:0:12275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49945f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.544925:0:12275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49945f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.544932:0:12275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49945f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.544948:0:12275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5800 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179153.544953:0:12275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49945f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.544961:0:12275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49945f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.544974:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:2.0:1788179153.544977:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179153.544982:0:12275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49945f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.544989:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49945f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.545004:0:12275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.545011:0:12275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499466 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.545017:0:12275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499466 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.545022:0:12275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c4a00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179153.545024:0:12275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499466 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.545030:0:12275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499466 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.545046:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bc909481400) 00010000:00010000:2.0:1788179153.545049:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179153.545052:0:12275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499466 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.545057:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499466 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.545080:0:12275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c49946d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.545085:0:12275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c49946d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.545090:0:12275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c49946d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.545096:0:12275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5600 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179153.545099:0:12275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c49946d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.545104:0:12275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c49946d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.545110:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312d00) 00010000:00010000:2.0:1788179153.545112:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179153.545115:0:12275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c49946d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.545121:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c49946d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179153.545221:0:12275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f82c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+35:11351:x1875041451052672:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 668us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179153.545229:0:12275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 151 00000100:00100000:0.0:1788179153.550748:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179153.550919:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451052928 00000100:00100000:2.0:1788179153.550929:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451052928 00000100:00100000:2.0:1788179153.550985:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00100000:2.0:1788179153.550995:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+35:11351:x1875041451052928:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:2.0:1788179153.551559:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+36:11351:x1875041451052928:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 563us (829us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788179153.551568:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00100000:1.0:1788179153.617331:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179153.617409:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451053184 00000100:00100000:0.0:1788179153.617420:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451053184 00000100:00100000:0.0:1788179153.617494:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 152 00000100:00100000:0.0:1788179153.617504:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f82c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+36:11354:x1875041451053184:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788179153.617529:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179153.617550:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499474 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746621d1 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.617623:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c49947b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.617636:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c49947b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.617646:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c49947b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.617660:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499482 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.617667:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.617673:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.617802:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c499489 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.617824:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c499489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.617831:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c499489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179153.617840:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788179153.617969:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c49947b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.617977:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c49947b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.617984:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c49947b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.617994:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179153.617999:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c49947b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.618006:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c49947b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.618017:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:0.0:1788179153.618020:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179153.618023:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c49947b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.618029:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c49947b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.618043:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499482 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.618224:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499482 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.618230:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499482 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.618234:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179153.618237:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499482 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.618243:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499482 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.618250:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bc9062cb900) 00010000:00010000:0.0:1788179153.618253:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179153.618255:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499482 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.618261:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499482 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.618300:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499474 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621d1 expref: 39 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.618313:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c499489 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621d1 expref: 38 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.618321:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312d00) 00010000:00010000:0.0:1788179153.618323:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788179153.618331:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317f400, rc 0) 00000100:00100000:0.0:1788179153.618434:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f82c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+38:11354:x1875041451053184:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 922us (1103us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1788179153.618442:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 152 00000100:00100000:3.0:1788179153.626209:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179153.626292:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451053312 00000100:00100000:2.0:1788179153.626301:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451053312 00000100:00100000:2.0:1788179153.626361:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 153 00000100:00100000:2.0:1788179153.626371:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e6bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+38:11354:x1875041451053312:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:2.0:1788179153.626454:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499497 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.626471:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.626482:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.626508:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.626514:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499497 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.626533:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499497 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.626541:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5600 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179153.626545:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499497 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.626552:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499497 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.626564:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312d00) 00010000:00010000:2.0:1788179153.626567:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788179153.626572:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499497 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.626578:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499497 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179153.626658:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e6bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+38:11354:x1875041451053312:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 287us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179153.626666:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 153 00000100:00100000:3.0:1788179153.628933:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179153.629064:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451053568 00000100:00100000:2.0:1788179153.629072:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451053568 00000100:00100000:2.0:1788179153.629116:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 41 00000100:00100000:2.0:1788179153.629126:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e6be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+38:11354:x1875041451053568:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:2.0:1788179153.629340:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e6be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+39:11354:x1875041451053568:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 215us (414us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788179153.629348:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 41 00000001:00080000:3.0:1788179153.692178:0:7496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:3.0:1788179153.692197:0:7496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:3.0:1788179153.892627:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179153.892753:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451053824 00000100:00100000:0.0:1788179153.892764:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451053824 00000100:00100000:0.0:1788179153.892824:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 154 00000100:00100000:0.0:1788179153.892834:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e6bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+39:11385:x1875041451053824:12345-192.168.202.2@tcp:101:cat.0 00010000:00010000:0.0:1788179153.892899:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179153.892921:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c49949e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746621d8 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.893016:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4994a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.893029:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4994a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.893040:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4994a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179153.893049:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788179153.893182:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c49949e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621d8 expref: 42 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.893201:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4994a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621d8 expref: 41 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.893210:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312d00) 00010000:00010000:0.0:1788179153.893227:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788179153.893231:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317f000, rc 0) 00000100:00100000:0.0:1788179153.893278:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e6bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+41:11385:x1875041451053824:12345-192.168.202.2@tcp:101:cat.0 Request processed in 445us (661us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788179153.893284:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 154 00000100:00100000:3.0:1788179153.896481:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179153.896542:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451053952 00000100:00100000:0.0:1788179153.896552:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451053952 00000100:00100000:0.0:1788179153.896620:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:0.0:1788179153.896630:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e6bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+41:2354:x1875041451053952:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179153.896644:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179153.896676:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4994a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621d8 expref: 41 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.896696:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312d00) 00010000:00010000:0.0:1788179153.896701:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179153.896769:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e6bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+40:2354:x1875041451053952:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 139us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179153.896776:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:3.0:1788179153.898164:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179153.898361:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451054208 00000100:00100000:2.0:1788179153.898369:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451054208 00000100:00100000:2.0:1788179153.898454:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:2.0:1788179153.898471:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e6bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+40:11385:x1875041451054208:12345-192.168.202.2@tcp:35:cat.0 00000100:00100000:2.0:1788179153.898713:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e6bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+41:11385:x1875041451054208:12345-192.168.202.2@tcp:35:cat.0 Request processed in 244us (552us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788179153.898722:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:3.0:1788179153.959219:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179153.959287:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451054464 00000100:00100000:0.0:1788179153.959296:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451054464 00000100:00100000:0.0:1788179153.959412:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 155 00000100:00100000:0.0:1788179153.959463:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e6bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+41:11391:x1875041451054464:12345-192.168.202.2@tcp:101:dd.0 00010000:00010000:0.0:1788179153.959487:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179153.959490:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788179153.959512:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499404 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621a7 expref: 41 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.959541:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:0.0:1788179153.959544:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788179153.959564:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4994b3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746621df expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.959652:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4994ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.959664:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c499489 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621d1 expref: 41 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.959678:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4994ba lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.959710:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c499489 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621d1 expref: 41 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.959720:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c499489 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621d1 expref: 41 pid: 5797 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179153.959748:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc90121a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1875041472030208:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788179153.959910:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc8013bff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788179153.964535:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc90121a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1875041472030208:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788179153.964578:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4994ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179153.966702:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179153.968088:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451054592 00000100:00100000:0.0:1788179153.968121:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451054592 00010000:00010000:0.0:1788179153.968164:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c499489 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621d1 expref: 42 pid: 5797 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179153.968198:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 66 00000100:00100000:0.0:1788179153.968208:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e6bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+42:2356:x1875041451054592:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179153.968225:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179153.968232:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c499489 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621d1 expref: 42 pid: 5797 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.968247:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c499489 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621d1 expref: 42 pid: 5797 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.968267:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c499489 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621d1 expref: 42 pid: 5797 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.968284:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312d00) 00010000:00010000:0.0:1788179153.968290:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4994ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.968300:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4994ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.968307:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4994ba lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.968340:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179153.968414:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e6bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+41:2356:x1875041451054592:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 207us (1721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179153.968430:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 66 00010000:00010000:3.0:1788179153.968951:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4994ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.968962:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4994ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179153.968980:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788179153.969145:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4994b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621df expref: 42 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.969163:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4994ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621df expref: 41 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179153.969171:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312d00) 00010000:00010000:3.0:1788179153.969173:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788179153.969176:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317fa00, rc 0) 00000100:00100000:3.0:1788179153.969222:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e6bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+41:11391:x1875041451054464:12345-192.168.202.2@tcp:101:dd.0 Request processed in 9797us (10012us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788179153.969241:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 155 00000100:00100000:3.0:1788179153.972447:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179153.972770:0:12275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451054848 00000100:00100000:2.0:1788179153.972781:0:12275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451054848 00000100:00100000:2.0:1788179153.972843:0:12275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 156 00000100:00100000:2.0:1788179153.972884:0:12275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e6bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+41:11391:x1875041451054848:12345-192.168.202.2@tcp:36:dd.0 00010000:00010000:2.0:1788179153.973273:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4994c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.973291:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4994c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179153.973302:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4994c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788179153.973357:0:12275:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1788179153.973398:0:12275:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001aeb476c reply state 00000000c9f1675c transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4994c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179153.973407:0:12275:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788179153.973504:0:12275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e6bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+44:11391:x1875041451054848:12345-192.168.202.2@tcp:36:dd.0 Request processed in 622us (1066us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788179153.973513:0:12275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 156 00000020:00080000:2.0:1788179153.973519:0:12275:0:(tgt_main.c:811:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788179153.990097:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4994c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.990118:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4994c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.990126:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4994c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.990132:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5800 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179153.990137:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4994c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.990144:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4994c8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.990161:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312d00) 00010000:00010000:0.0:1788179153.990163:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179153.990169:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4994c8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179153.990175:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4994c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179154.068801:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179154.068842:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179154.068891:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451054976 00000100:00100000:1.0:1788179154.068903:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451054976 00000100:00100000:1.0:1788179154.068961:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 295 00000100:00100000:1.0:1788179154.068973:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2357:x1875041451054976:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179154.069062:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2357:x1875041451054976:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 83us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179154.069070:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 295 00000100:00100000:2.0:1788179154.071063:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451055104 00000100:00100000:2.0:1788179154.071076:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451055104 00000100:00100000:2.0:1788179154.071175:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 88 00000100:00100000:2.0:1788179154.071186:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e6bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2356:x1875041451055104:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788179154.071252:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e6bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2356:x1875041451055104:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 68us (2408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179154.071260:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 88 00000100:00080000:3.0:1788179154.071359:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788179154.074144:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179154.074180:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179154.074196:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451055232 00000100:00100000:1.0:1788179154.074205:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451055232 00000100:00100000:1.0:1788179154.074263:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 89 00000100:00100000:1.0:1788179154.074287:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e6bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2357:x1875041451055232:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179154.074360:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e6bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2357:x1875041451055232:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 74us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179154.074368:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 89 00000100:00100000:0.0:1788179154.074656:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451055360 00000100:00100000:0.0:1788179154.074662:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451055360 00000100:00100000:0.0:1788179154.074760:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 150 00000100:00100000:0.0:1788179154.074769:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e6bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2356:x1875041451055360:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179154.074814:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e6bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2356:x1875041451055360:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 47us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179154.074828:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 150 00010000:00010000:0.0:1788179154.176783:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179154.287490:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179154.287572:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451055488 00000100:00100000:0.0:1788179154.287583:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451055488 00000100:00100000:0.0:1788179154.287649:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 157 00000100:00100000:0.0:1788179154.287660:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e6bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+43:11406:x1875041451055488:12345-192.168.202.2@tcp:101:stat.0 00010000:00010000:0.0:1788179154.287686:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179154.287707:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4994cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746621e6 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.287811:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4994d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.287839:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4994d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.287884:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4994d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.287900:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4994dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.287908:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4994dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.287915:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4994dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.288017:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c4994e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.288050:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4994ba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621df expref: 44 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.288058:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c4994e4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.288090:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4994ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621df expref: 44 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.288103:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4994ba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621df expref: 44 pid: 5797 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179154.288116:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc90121a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1875041472030336:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788179154.288201:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc8013bff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788179154.291207:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179154.291236:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc90121a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1875041472030336:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788179154.291261:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c4994e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179154.291310:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451055744 00000100:00100000:2.0:1788179154.291316:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451055744 00000100:00100000:2.0:1788179154.291364:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:2.0:1788179154.291372:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+45:5570:x1875041451055744:12345-192.168.202.2@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788179154.291638:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+46:5570:x1875041451055744:12345-192.168.202.2@tcp:35:ldlm_bl.0 Request processed in 267us (441us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1788179154.291643:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:3.0:1788179154.293582:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179154.293636:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451055872 00000100:00100000:0.0:1788179154.293645:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451055872 00010000:00010000:0.0:1788179154.293679:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4994ba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621df expref: 46 pid: 5797 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179154.293718:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 67 00000100:00100000:0.0:1788179154.293743:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e6bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+46:2357:x1875041451055872:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179154.293758:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179154.293778:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4994ba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621df expref: 46 pid: 5797 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.293791:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4994ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621df expref: 46 pid: 5797 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.293813:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4994ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621df expref: 46 pid: 5797 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.293841:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312d00) 00010000:00010000:0.0:1788179154.293847:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c4994e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.293897:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c4994e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.293905:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c4994e4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.293931:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788179154.293964:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c4994e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.293973:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c4994e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179154.294016:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788179154.294020:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788179154.294039:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c4994e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.294053:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c4994e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.294063:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4994d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.294069:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4994d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.294076:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4994d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.294093:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179154.294098:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4994d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.294106:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4994d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.294117:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:3.0:1788179154.294120:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179154.294124:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4994d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.294130:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4994d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179154.294137:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e6bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+45:2357:x1875041451055872:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 409us (557us total) trans 0 rc 0/0 00010000:00010000:3.0:1788179154.294145:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4994dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179154.294149:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 67 00010000:00010000:3.0:1788179154.294158:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4994dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.294165:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4994dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.294170:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317ee00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179154.294173:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4994dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.294179:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4994dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.294197:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bc9062cb700) 00010000:00010000:3.0:1788179154.294200:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179154.294203:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4994dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.294208:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4994dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.294242:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4994cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621e6 expref: 45 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.294255:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c4994e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621e6 expref: 44 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.294263:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312d00) 00010000:00010000:3.0:1788179154.294265:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788179154.294267:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317f400, rc 0) 00000100:00100000:3.0:1788179154.294294:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e6bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+44:11406:x1875041451055488:12345-192.168.202.2@tcp:101:stat.0 Request processed in 6637us (6814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179154.294302:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 157 00000100:00100000:3.0:1788179154.365203:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179154.365254:0:12275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451056128 00000100:00100000:2.0:1788179154.365264:0:12275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451056128 00000100:00100000:2.0:1788179154.365320:0:12275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 158 00000100:00100000:2.0:1788179154.365327:0:12275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e6bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+44:11412:x1875041451056128:12345-192.168.202.2@tcp:36:truncate.0 00010000:00010000:2.0:1788179154.365378:0:12275:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179154.365401:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c4994e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621e6 expref: 44 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179154.365415:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312d00) 00010000:00010000:2.0:1788179154.365419:0:12275:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788179154.365607:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c4994eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179154.365637:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c4994eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179154.365645:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c4994eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788179154.365704:0:12275:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788179154.365735:0:12275:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cd8aacb8 reply state 00000000700dcd0f transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c4994eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179154.365742:0:12275:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788179154.365820:0:12275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e6bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+46:11412:x1875041451056128:12345-192.168.202.2@tcp:36:truncate.0 Request processed in 493us (627us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788179154.365828:0:12275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 158 00000020:00080000:2.0:1788179154.365833:0:12275:0:(tgt_main.c:811:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788179154.368528:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c4994eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.368547:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c4994eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.368555:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c4994eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.368574:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c4600 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179154.368577:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c4994eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.368583:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c4994eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.368598:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312d00) 00010000:00010000:3.0:1788179154.368601:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179154.368605:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c4994eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.368611:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c4994eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179154.477470:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179154.477613:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451056256 00000100:00100000:0.0:1788179154.477624:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451056256 00000100:00100000:0.0:1788179154.477743:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 159 00000100:00100000:0.0:1788179154.477755:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e6bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+45:11426:x1875041451056256:12345-192.168.202.2@tcp:101:stat.0 00010000:00010000:0.0:1788179154.477783:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179154.477805:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4994f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746621ed expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.477957:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4994f9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.477975:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4994f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.477986:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4994f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.478003:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c499500 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.478011:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c499500 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.478019:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c499500 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.478135:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499507 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.478144:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499507 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.478152:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499507 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179154.478199:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788179154.478205:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788179154.478226:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499507 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.478249:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499507 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.478259:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4994f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.478266:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4994f9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.478273:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4994f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.478279:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179154.478283:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4994f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.478290:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4994f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.478316:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:0.0:1788179154.478319:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179154.478324:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4994f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.478331:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4994f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.478344:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c499500 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.478350:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c499500 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.478361:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c499500 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.478366:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f400 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179154.478369:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c499500 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.478375:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c499500 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.478384:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bc9062cb900) 00010000:00010000:0.0:1788179154.478386:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179154.478389:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c499500 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.478394:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c499500 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.478424:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4994f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621ed expref: 47 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.478437:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499507 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621ed expref: 46 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.478444:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312d00) 00010000:00010000:0.0:1788179154.478446:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788179154.478449:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317e200, rc 0) 00000100:00100000:0.0:1788179154.478521:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e6bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+46:11426:x1875041451056256:12345-192.168.202.2@tcp:101:stat.0 Request processed in 768us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179154.478536:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 159 00000100:00100000:2.0:1788179154.522315:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179154.522367:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451056512 00000100:00100000:3.0:1788179154.522377:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451056512 00000100:00100000:3.0:1788179154.522429:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 160 00000100:00100000:3.0:1788179154.522440:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fcf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+46:11436:x1875041451056512:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1788179154.522463:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179154.522484:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c49950e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746621f4 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179154.522968:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1788179154.523096:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c49950e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621f4 expref: 48 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.523110:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc903312a00) 00010000:00010000:3.0:1788179154.523125:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788179154.523131:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c49950e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621f4 expref: 48 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.523146:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b5600, rc 0) 00000100:00100000:3.0:1788179154.523200:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fcf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+47:11436:x1875041451056512:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 763us (908us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1788179154.523208:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 160 00000100:00100000:2.0:1788179154.524705:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179154.524807:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451056768 00000100:00100000:3.0:1788179154.524815:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451056768 00000100:00100000:3.0:1788179154.524905:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:3.0:1788179154.524915:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9266fe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+47:11436:x1875041451056768:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:3.0:1788179154.525117:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9266fe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+48:11436:x1875041451056768:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 204us (418us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788179154.525126:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:1.0:1788179154.581972:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179154.582073:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451057024 00000100:00100000:2.0:1788179154.582083:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451057024 00000100:00100000:2.0:1788179154.582144:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 161 00000100:00100000:2.0:1788179154.582155:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+48:11442:x1875041451057024:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1788179154.582178:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179154.582204:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49951c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746621fb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179154.582299:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499523 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179154.582315:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499507 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621ed expref: 49 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179154.582336:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499523 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179154.582366:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499507 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621ed expref: 49 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179154.582378:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499507 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621ed expref: 49 pid: 5798 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179154.582390:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93fcf7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5827:1875041472030464:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788179154.582491:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc910967540 going to sleep for 11 seconds 00000100:00100000:1.0:1788179154.586626:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179154.586742:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451057152 00000100:00100000:0.0:1788179154.586752:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451057152 00010000:00010000:0.0:1788179154.586793:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499507 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621ed expref: 50 pid: 5798 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179154.586806:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93fcf7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5827:1875041472030464:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788179154.586827:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 68 00010000:00010000:2.0:1788179154.586834:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499523 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179154.586835:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+50:2357:x1875041451057152:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179154.586882:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179154.586888:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499507 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621ed expref: 50 pid: 5798 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.586898:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499507 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621ed expref: 50 pid: 5798 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.586914:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499507 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621ed expref: 50 pid: 5798 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.586938:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312d00) 00010000:00010000:0.0:1788179154.586944:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499523 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.586953:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499523 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.586961:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499523 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.587000:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179154.587041:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+49:2357:x1875041451057152:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 207us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179154.587046:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 68 00010000:00010000:2.0:1788179154.587371:0:5827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499523 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179154.587380:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499523 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179154.587398:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788179154.587545:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49951c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621fb expref: 50 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179154.587560:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499523 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621fb expref: 49 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179154.587577:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312d00) 00010000:00010000:2.0:1788179154.587580:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788179154.587582:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c4a00, rc 0) 00000100:00100000:2.0:1788179154.587623:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+49:11442:x1875041451057024:12345-192.168.202.2@tcp:101:bash.0 Request processed in 5470us (5659us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788179154.587630:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 161 00000100:00100000:1.0:1788179154.589205:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179154.589243:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451057408 00000100:00100000:0.0:1788179154.589251:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451057408 00000100:00100000:0.0:1788179154.589295:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 162 00000100:00100000:0.0:1788179154.589304:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+49:11442:x1875041451057408:12345-192.168.202.2@tcp:36:bash.0 00010000:00010000:0.0:1788179154.589535:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499531 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.589551:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.589561:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788179154.589606:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1788179154.589627:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c84a4e70 reply state 00000000553b15b6 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179154.589636:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788179154.589705:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+52:11442:x1875041451057408:12345-192.168.202.2@tcp:36:bash.0 Request processed in 398us (500us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788179154.589712:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 162 00000020:00080000:0.0:1788179154.589717:0:5798:0:(tgt_main.c:811:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788179154.590831:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179154.590844:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499531 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179154.590877:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499531 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179154.590883:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317fa00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179154.590887:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499531 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179154.590894:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499531 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179154.590911:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312d00) 00010000:00010000:1.0:1788179154.590914:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179154.590931:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499531 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179154.590938:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499531 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179154.601208:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179154.601366:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451057536 00000100:00100000:3.0:1788179154.601375:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451057536 00000100:00100000:3.0:1788179154.601433:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 163 00000100:00100000:3.0:1788179154.601444:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+51:11442:x1875041451057536:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:3.0:1788179154.601467:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179154.601487:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499538 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662202 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.601564:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c49953f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.601579:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499523 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621fb expref: 52 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.601595:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c49953f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.601628:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499523 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621fb expref: 52 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.601641:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499523 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621fb expref: 52 pid: 5827 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179154.601653:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e6be300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1875041472030592:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788179154.601740:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93fadcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788179154.608941:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179154.609460:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e6be300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1875041472030592:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788179154.609489:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c49953f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179154.611903:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451057664 00000100:00100000:2.0:1788179154.611918:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451057664 00010000:00010000:2.0:1788179154.611968:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499523 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621fb expref: 53 pid: 5827 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179154.612082:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 69 00000100:00100000:2.0:1788179154.612094:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e6bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+53:2356:x1875041451057664:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788179154.612110:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179154.612118:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499523 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621fb expref: 53 pid: 5827 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179154.612133:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499523 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621fb expref: 53 pid: 5827 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179154.612155:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499523 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746621fb expref: 53 pid: 5827 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179154.612174:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312d00) 00010000:00010000:2.0:1788179154.612179:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c49953f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179154.612203:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c49953f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179154.612211:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c49953f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179154.612246:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788179154.612337:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e6bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+52:2356:x1875041451057664:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 240us (3495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179154.612345:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 69 00010000:00010000:0.0:1788179154.613188:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c49953f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.613200:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c49953f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179154.613273:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788179154.613279:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788179154.613307:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c49953f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.613343:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499538 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662202 expref: 52 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.613360:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c49953f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662202 expref: 51 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.613368:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312d00) 00010000:00010000:0.0:1788179154.613371:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788179154.613374:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b5000, rc 0) 00000100:00100000:0.0:1788179154.613425:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+51:11442:x1875041451057536:12345-192.168.202.2@tcp:101:bash.0 Request processed in 11983us (12226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179154.613433:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 163 00000100:00100000:3.0:1788179154.621325:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179154.621402:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451057920 00000100:00100000:0.0:1788179154.621412:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451057920 00000100:00100000:0.0:1788179154.621470:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00100000:0.0:1788179154.621480:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e6be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+51:11442:x1875041451057920:12345-192.168.202.2@tcp:35:bash.0 00000100:00100000:0.0:1788179154.621733:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e6be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+52:11442:x1875041451057920:12345-192.168.202.2@tcp:35:bash.0 Request processed in 254us (416us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1788179154.621754:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 45 00000001:00080000:2.0:1788179154.687557:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967450 is committed 00000004:00080000:2.0:1788179154.687621:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788179154.687663:0:5818:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bc803c6f3c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788179154.687669:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9bc93b5ad900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bc803c6f180 00000020:00080000:2.0:1788179154.687673:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9bc93b5adc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bc93f6f1400 00000020:00080000:0.0:1788179154.687716:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:1.0:1788179154.687883:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e6bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472030720:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788179154.687960:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788179154.687962:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788179154.688246:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472030720 00000100:00100000:3.0:1788179154.688254:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472030720 00000100:00100000:3.0:1788179154.688342:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788179154.688353:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472030720:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788179154.688380:0:7778:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1788179154.688406:0:7778:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9572d0, atime: 0x6a9572d0, ctime: 0x6a9572d0, blocks: 0xb 00010000:00010000:3.0:1788179154.688413:0:7778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3a24993/0xaa4c98508c499546 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.688427:0:7778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=350s v=(0 0) 00010000:00010000:3.0:1788179154.688430:0:7778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788179154.688435:0:7778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3a24993/0xaa4c98508c499546 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.688461:0:7778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3a24993/0xaa4c98508c499546 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.688477:0:7778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3a24993/0xaa4c98508c499546 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.688486:0:7778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3a24993/0xaa4c98508c499546 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.688516:0:7778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1788179154.688653:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788179154.688878:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788179154.688886:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3a24993/0xaa4c98508c499546 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179154.688895:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4c00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:2.0:1788179154.688900:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3a24993/0xaa4c98508c499546 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179154.688911:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3a24993/0xaa4c98508c499546 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179154.688944:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3a24993/0xaa4c98508c499546 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179154.688953:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3a24993/0xaa4c98508c499546 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179154.688978:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179154.688982:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179154.688985:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179154.689109:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1875041472030720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 757us (1149us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788179154.689118:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788179154.689204:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1788179154.689210:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1788179154.689231:0:3307:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9bc92e6bea00 x1875041472030720/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788179170 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788179154.689242:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bc92e6bea00/2, rc 0, transno 4294967307 00000100:00100000:1.0:1788179154.689247:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e6bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472030720:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788179154.725122:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179154.725239:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451058176 00000100:00100000:2.0:1788179154.725249:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451058176 00000100:00100000:2.0:1788179154.725320:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 164 00000100:00100000:2.0:1788179154.725329:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e6be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+16:11452:x1875041451058176:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788179154.725352:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179154.725368:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49954d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662209 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179154.725603:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1788179154.725816:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49954d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662209 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179154.725842:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc903312a00) 00010000:00010000:2.0:1788179154.725844:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788179154.725886:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49954d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662209 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179154.725909:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c4a00, rc 0) 00000100:00100000:2.0:1788179154.725979:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e6be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+17:11452:x1875041451058176:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 651us (864us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1788179154.725987:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 164 00000100:00100000:1.0:1788179154.732058:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179154.732117:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451058304 00000100:00100000:0.0:1788179154.732128:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451058304 00000100:00100000:0.0:1788179154.732192:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 165 00000100:00100000:0.0:1788179154.732201:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+17:11452:x1875041451058304:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:0.0:1788179154.732278:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c49955b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732298:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c49955b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732312:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c49955b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732325:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499562 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732330:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732334:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732663:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c499569 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732670:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c499569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732682:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c499569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788179154.732716:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c499569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732738:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c49955b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732742:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c49955b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732747:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c49955b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732751:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f400 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179154.732754:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c49955b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732759:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c49955b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732767:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:0.0:1788179154.732769:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179154.732773:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c49955b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732777:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c49955b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732785:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732793:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499562 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732797:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499562 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732799:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179154.732801:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499562 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732804:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499562 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732808:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bc9062cb900) 00010000:00010000:0.0:1788179154.732810:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179154.732811:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499562 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732814:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499562 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732831:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c499569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732834:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c499569 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732838:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c499569 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732841:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317ee00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179154.732846:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c499569 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732883:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c499569 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732888:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312d00) 00010000:00010000:0.0:1788179154.732890:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179154.732892:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c499569 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.732896:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c499569 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179154.732961:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+17:11452:x1875041451058304:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 761us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179154.732966:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 165 00000100:00100000:0.0:1788179154.735228:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179154.735387:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451058560 00000100:00100000:2.0:1788179154.735395:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451058560 00000100:00100000:2.0:1788179154.735446:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:2.0:1788179154.735465:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90121a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+17:11452:x1875041451058560:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:2.0:1788179154.736017:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90121a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+18:11452:x1875041451058560:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 562us (795us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1788179154.736026:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:2.0:1788179154.778012:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179154.778105:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451058816 00000100:00100000:0.0:1788179154.778122:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451058816 00000100:00100000:0.0:1788179154.778247:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 166 00000100:00100000:0.0:1788179154.778263:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fcf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+18:11455:x1875041451058816:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788179154.778318:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179154.778360:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c499570 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662210 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.778492:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499577 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.778512:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499577 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.778561:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499577 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.778581:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c49957e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.778598:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c49957e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.778605:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c49957e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.779201:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499585 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.779214:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.779224:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179154.779238:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788179154.779354:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499577 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.779362:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499577 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.779369:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499577 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.779376:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179154.779387:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499577 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.779397:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499577 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.779412:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:0.0:1788179154.779416:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179154.779422:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499577 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.779430:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c499577 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.779449:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c49957e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.779457:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c49957e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.779463:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c49957e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.779468:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f400 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179154.779471:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c49957e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.779477:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c49957e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.779485:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bc9062cb900) 00010000:00010000:0.0:1788179154.779488:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179154.779500:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c49957e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.779507:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c49957e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.779564:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c499570 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662210 expref: 21 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.779580:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499585 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662210 expref: 20 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.779588:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312d00) 00010000:00010000:0.0:1788179154.779590:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788179154.779593:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317f200, rc 0) 00000100:00100000:0.0:1788179154.779699:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fcf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+20:11455:x1875041451058816:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 1440us (1705us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1788179154.779708:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 166 00000100:00100000:1.0:1788179154.783621:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179154.783697:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179154.783782:0:11517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451058944 00000100:00100000:0.0:1788179154.783795:0:11517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451058944 00000100:00100000:0.0:1788179154.783904:0:11517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:0.0:1788179154.783917:0:11517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+20:2354:x1875041451058944:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179154.783945:0:11517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179154.783994:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499585 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662210 expref: 20 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.784022:0:11517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312d00) 00010000:00010000:0.0:1788179154.784028:0:11517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179154.784116:0:11517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+19:2354:x1875041451058944:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 200us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179154.784123:0:11517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:3.0:1788179154.784400:0:12275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451059072 00000100:00100000:3.0:1788179154.784407:0:12275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451059072 00000100:00100000:3.0:1788179154.784452:0:12275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 167 00000100:00100000:3.0:1788179154.784461:0:12275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+19:11455:x1875041451059072:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:3.0:1788179154.784539:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c499593 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.784557:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c499593 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.784571:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c499593 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.784628:0:12275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c499593 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.784636:0:12275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c499593 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.784643:0:12275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c499593 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.784651:0:12275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5a00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179154.784657:0:12275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c499593 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.784665:0:12275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c499593 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.784676:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312d00) 00010000:00010000:3.0:1788179154.784679:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788179154.784684:0:12275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c499593 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.784690:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c499593 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179154.784765:0:12275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+19:11455:x1875041451059072:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 305us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179154.784772:0:12275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 167 00000100:00100000:1.0:1788179154.792968:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179154.793088:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451059328 00000100:00100000:0.0:1788179154.793100:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451059328 00000100:00100000:0.0:1788179154.793160:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:0.0:1788179154.793173:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+19:11455:x1875041451059328:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:0.0:1788179154.793422:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+20:11455:x1875041451059328:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 252us (466us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1788179154.793431:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:0.0:1788179154.900954:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179154.903835:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451059584 00000100:00100000:3.0:1788179154.903870:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451059584 00000100:00100000:3.0:1788179154.903938:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 168 00000100:00100000:3.0:1788179154.903959:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc901218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+20:11473:x1875041451059584:12345-192.168.202.2@tcp:101:cat.0 00010000:00010000:3.0:1788179154.903982:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179154.904002:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c49959a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662217 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.904090:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c4995a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.904102:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c4995a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.904113:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c4995a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179154.904122:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788179154.904242:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c49959a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662217 expref: 23 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.904260:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c4995a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662217 expref: 22 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.904268:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312d00) 00010000:00010000:3.0:1788179154.904271:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788179154.904274:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4c00, rc 0) 00000100:00100000:3.0:1788179154.904335:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc901218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+22:11473:x1875041451059584:12345-192.168.202.2@tcp:101:cat.0 Request processed in 377us (3391us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1788179154.904341:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 168 00000100:00100000:2.0:1788179154.917674:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179154.918161:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451059712 00000100:00100000:1.0:1788179154.918172:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451059712 00000100:00100000:1.0:1788179154.918231:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 169 00000100:00100000:1.0:1788179154.918242:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fcf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+22:11474:x1875041451059712:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788179154.918268:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179154.918299:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c4995af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466221e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179154.918364:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c4995b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179154.918378:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c4995b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179154.918402:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c4995b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788179154.919151:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1788179154.919157:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788179154.919233:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c4995b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179154.919263:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c4995af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466221e expref: 24 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179154.919281:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c4995b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466221e expref: 23 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179154.919349:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:1.0:1788179154.919353:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788179154.919357:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc942172e00, rc 0) 00000100:00100000:1.0:1788179154.919735:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fcf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+23:11474:x1875041451059712:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 1493us (2067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179154.919743:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 169 00000100:00100000:1.0:1788179154.926792:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179154.926903:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451060096 00000100:00100000:3.0:1788179154.926915:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451060096 00000100:00100000:3.0:1788179154.926987:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:3.0:1788179154.926998:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+23:11474:x1875041451060096:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:3.0:1788179154.927388:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+24:11474:x1875041451060096:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 391us (608us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788179154.927397:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:0.0:1788179154.932986:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179154.934282:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451060224 00000100:00100000:1.0:1788179154.934306:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451060224 00000100:00100000:1.0:1788179154.934382:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:1.0:1788179154.934394:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90710d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+24:11474:x1875041451060224:12345-192.168.202.2@tcp:103:lfs.0 00010000:00010000:1.0:1788179154.934411:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788179154.934438:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c49953f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662202 expref: 24 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179154.934484:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c4995a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662217 expref: 23 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179154.934497:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c49944a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746621c3 expref: 22 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179154.934507:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc903312d00) 00010000:00010000:1.0:1788179154.934519:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788179154.936447:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90710d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+21:11474:x1875041451060224:12345-192.168.202.2@tcp:103:lfs.0 Request processed in 193us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179154.936460:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:2.0:1788179154.940349:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179154.940435:0:12275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451060352 00000100:00100000:3.0:1788179154.940454:0:12275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451060352 00000100:00100000:3.0:1788179154.940528:0:12275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 170 00000100:00100000:3.0:1788179154.940539:0:12275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fcf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+21:11474:x1875041451060352:12345-192.168.202.2@tcp:58:lfs.0 00010000:00010000:3.0:1788179154.940686:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4995bd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.940703:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4995bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179154.940728:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4995bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788179154.941613:0:12275:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788179154.942068:0:12275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fcf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+21:11474:x1875041451060352:12345-192.168.202.2@tcp:58:lfs.0 Request processed in 1530us (1727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179154.942078:0:12275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 170 00000100:00100000:3.0:1788179154.976841:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179154.977302:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451060480 00000100:00100000:0.0:1788179154.977313:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451060480 00000100:00100000:0.0:1788179154.977365:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 171 00000100:00100000:0.0:1788179154.977377:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e6bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+21:11476:x1875041451060480:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788179154.977397:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179154.977416:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c4995c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662225 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.977613:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4995cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.977674:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4995cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.977687:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4995cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.977770:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4995d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.977778:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4995d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.977785:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4995d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.978339:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4995d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.978349:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4995d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.978356:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4995d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179154.978391:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788179154.978394:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788179154.978409:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4995d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.978419:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4995d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.978427:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4995cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.978434:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4995cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.978451:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4995cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.978457:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179154.978461:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4995cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.978469:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4995cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.978680:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:0.0:1788179154.978685:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179154.978689:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4995cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.978695:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4995cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.978777:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4995d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.978783:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4995d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.978789:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4995d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.978795:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317fa00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179154.978798:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4995d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.978813:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4995d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.978821:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bc9062cb900) 00010000:00010000:0.0:1788179154.978823:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179154.978826:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4995d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.978831:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4995d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.979064:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c4995c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662225 expref: 23 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.979079:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4995d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662225 expref: 22 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179154.979087:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc902d54200) 00010000:00010000:0.0:1788179154.979089:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788179154.979091:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317ee00, rc 0) 00000100:00100000:0.0:1788179154.979216:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e6bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+22:11476:x1875041451060480:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 1840us (2381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179154.979224:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 171 00010000:00010000:1.0:1788179155.200038:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788179155.510438:0:12361:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788179155.510448:0:12361:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788179155.510497:0:12361:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1788179155.510505:0:12361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788179155.670289:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788179155.670296:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788179155.670360:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1788179155.670370:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788179155.670614:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a20a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1875041472030848:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788179155.670822:0:11535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e8e8480 going to sleep for 11 seconds 00000100:00100000:0.0:1788179155.677232:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a20a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1875041472030848:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788179155.683061:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179155.683101:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451060608 00000100:00100000:3.0:1788179155.683111:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451060608 00000100:00100000:3.0:1788179155.683166:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 172 00000100:00100000:3.0:1788179155.683176:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e6bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+22:11488:x1875041451060608:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788179155.683215:0:5827:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788179155.684285:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e6bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+22:11488:x1875041451060608:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 1107us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179155.684295:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 172 00000100:00080000:3.0:1788179155.684319:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788179155.693063:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179155.693104:0:12275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451060736 00000100:00100000:3.0:1788179155.693114:0:12275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451060736 00000100:00100000:3.0:1788179155.693174:0:12275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 173 00000100:00100000:3.0:1788179155.693184:0:12275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+22:11488:x1875041451060736:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788179155.693260:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c4995e0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693277:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c4995e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693288:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c4995e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693344:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c4995e7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693353:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c4995e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693360:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c4995e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693386:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4995ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693411:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4995ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693419:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4995ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179155.693455:0:12275:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788179155.693460:0:12275:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788179155.693472:0:12275:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4995ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693483:0:12275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c4995e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693504:0:12275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c4995e0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693511:0:12275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c4995e0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693518:0:12275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5600 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179155.693522:0:12275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c4995e0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693529:0:12275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c4995e0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693540:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bc903340c00) 00010000:00010000:3.0:1788179155.693543:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179155.693558:0:12275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c4995e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693575:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c4995e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693588:0:12275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c4995e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693594:0:12275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c4995e7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693600:0:12275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c4995e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693606:0:12275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179155.693609:0:12275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c4995e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693616:0:12275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c4995e7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693624:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9bc902d54d00) 00010000:00010000:3.0:1788179155.693626:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179155.693630:0:12275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c4995e7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693635:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c4995e7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693650:0:12275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4995ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693657:0:12275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4995ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693669:0:12275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4995ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693674:0:12275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5e00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179155.693677:0:12275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4995ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693683:0:12275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4995ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693690:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc902d54200) 00010000:00010000:3.0:1788179155.693692:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179155.693694:0:12275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4995ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.693723:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4995ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179155.694119:0:12275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+22:11488:x1875041451060736:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 Request processed in 935us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179155.694127:0:12275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 173 00000100:00100000:3.0:1788179155.697061:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179155.698790:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451060992 00000100:00100000:0.0:1788179155.698803:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451060992 00000100:00100000:0.0:1788179155.698875:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 174 00000100:00100000:0.0:1788179155.698885:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e6bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+22:11488:x1875041451060992:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788179155.698919:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179155.698938:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4995f5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466222c expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.699027:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4995fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.699040:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4995fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.699051:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4995fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179155.699061:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788179155.699143:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4995fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.699151:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4995fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.699158:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4995fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.699163:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179155.699168:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4995fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.699175:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4995fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.699186:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc902d54200) 00010000:00010000:0.0:1788179155.699193:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788179155.699198:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4995fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.699205:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4995fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.699239:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4995f5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466222c expref: 24 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.699248:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bc903340c00) 00010000:00010000:0.0:1788179155.699250:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788179155.699254:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c4995f5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466222c expref: 24 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.699263:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317f200, rc 0) 00000100:00100000:0.0:1788179155.699317:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e6bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+23:11488:x1875041451060992:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 433us (2267us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1788179155.699324:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 174 00000100:00100000:0.0:1788179155.707569:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179155.707783:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451061120 00000100:00100000:3.0:1788179155.707793:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451061120 00000100:00100000:3.0:1788179155.708002:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 175 00000100:00100000:3.0:1788179155.708014:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc901218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+23:11488:x1875041451061120:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788179155.708515:0:5827:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788179155.708634:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc901218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+23:11488:x1875041451061120:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 622us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179155.709640:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 175 00000100:00100000:3.0:1788179155.711161:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179155.711295:0:12275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451061376 00000100:00100000:2.0:1788179155.711305:0:12275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451061376 00000100:00100000:2.0:1788179155.711357:0:12275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 176 00000100:00100000:2.0:1788179155.711367:0:12275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e6bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+23:11488:x1875041451061376:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788179155.711388:0:12275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179155.711391:0:12275:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788179155.711416:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c4995b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466221e expref: 23 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.711440:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:2.0:1788179155.711443:0:12275:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788179155.711454:0:12275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49960a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662233 expref: -99 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788179155.712193:0:12275:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788179155.712364:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499611 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.712374:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.712380:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.712416:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49960a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662233 expref: 25 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.712426:0:12275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499611 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662233 expref: 24 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.712431:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bc909481400) 00010000:00010000:2.0:1788179155.712433:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788179155.712435:0:12275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c4a00, rc 0) 00000100:00100000:2.0:1788179155.712473:0:12275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e6bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+24:11488:x1875041451061376:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 1109us (1316us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788179155.712478:0:12275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 176 00000100:00100000:0.0:1788179155.720384:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179155.720469:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451061632 00000100:00100000:3.0:1788179155.720479:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451061632 00000100:00100000:3.0:1788179155.720538:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 177 00000100:00100000:3.0:1788179155.720549:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc901219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+24:11488:x1875041451061632:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788179155.720604:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179155.720631:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c499611 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662233 expref: 24 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.720649:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bc909481400) 00010000:00010000:3.0:1788179155.720668:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788179155.720689:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c49961f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.720702:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c49961f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.720722:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c49961f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.720737:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499626 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xd441bb4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.720744:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499626 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd441bb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.720751:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499626 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd441bb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.722203:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c49961f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.722216:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c49961f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.722237:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c49961f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.722243:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4800 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179155.722248:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c49961f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.722256:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c49961f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.722268:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:3.0:1788179155.722271:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179155.722276:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c49961f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.722281:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c49961f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.722312:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499626 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd441bb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.722318:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499626 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd441bb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.722325:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499626 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd441bb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.722336:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5e00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179155.722339:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499626 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd441bb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.722345:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499626 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd441bb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.722353:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xd441bb4 (ffff9bc902d54d00) 00010000:00010000:3.0:1788179155.722356:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179155.722359:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499626 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd441bb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.722365:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499626 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd441bb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179155.722456:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc901219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+23:11488:x1875041451061632:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 1906us (2079us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788179155.722465:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 177 00000100:00100000:0.0:1788179155.724384:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179155.724429:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451061760 00000100:00100000:3.0:1788179155.724439:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451061760 00000100:00100000:3.0:1788179155.724488:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 178 00000100:00100000:3.0:1788179155.724498:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc901218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+23:11488:x1875041451061760:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788179155.724517:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179155.724537:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c49962d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466223a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.724569:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499634 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.724597:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.724608:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.724705:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c49962d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466223a expref: 25 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.724732:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499634 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466223a expref: 24 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.724741:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bc902d54500) 00010000:00010000:3.0:1788179155.724744:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788179155.724747:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b5600, rc 0) 00000100:00100000:3.0:1788179155.724799:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc901218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+24:11488:x1875041451061760:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 302us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179155.724805:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 178 00000100:00100000:1.0:1788179155.732085:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179155.732158:0:12275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451062016 00000100:00100000:2.0:1788179155.732166:0:12275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451062016 00000100:00100000:2.0:1788179155.732210:0:12275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 179 00000100:00100000:2.0:1788179155.732217:0:12275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+24:11488:x1875041451062016:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788179155.732297:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49963b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.732310:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49963b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.732317:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49963b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788179155.732570:0:12275:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1788179155.732581:0:12275:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 351795730495ns, next at 352795727714ns, rc = 0 00000004:00010000:2.0:1788179155.732650:0:12275:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009d762294 reply state 00000000b5314fb7 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49963b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179155.732657:0:12275:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788179155.732753:0:12275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+26:11488:x1875041451062016:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 534us (674us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1788179155.732760:0:12275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 179 00010000:00010000:3.0:1788179155.733797:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49963b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.733808:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49963b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.733816:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49963b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.733822:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5800 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179155.733827:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49963b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.733888:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49963b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.733908:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bc902d54500) 00010000:00010000:3.0:1788179155.733912:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788179155.733917:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49963b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.733923:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49963b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179155.734145:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179155.734181:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451062144 00000100:00100000:3.0:1788179155.734187:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451062144 00000100:00100000:3.0:1788179155.734279:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 180 00000100:00100000:3.0:1788179155.734290:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+25:11488:x1875041451062144:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788179155.734317:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179155.734346:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c499642 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662241 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.734401:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c499642 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662241 expref: 26 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.734411:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c499642 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662241 expref: 26 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.734424:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bc902d54500) 00010000:00010000:3.0:1788179155.734426:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788179155.734428:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4600, rc 0) 00000100:00100000:3.0:1788179155.734470:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+26:11488:x1875041451062144:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 184us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179155.734475:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 180 00000100:00100000:0.0:1788179155.736793:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179155.736885:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451062272 00000100:00100000:2.0:1788179155.736894:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451062272 00000100:00100000:1.0:1788179155.737001:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:1.0:1788179155.737010:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90121b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2357:x1875041451062272:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788179155.737243:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90121b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2357:x1875041451062272:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 234us (456us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788179155.737260:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:0.0:1788179155.739332:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179155.739390:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451062528 00000100:00100000:2.0:1788179155.739396:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451062528 00000100:00100000:2.0:1788179155.739428:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:2.0:1788179155.739434:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc901219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+26:11488:x1875041451062528:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788179155.739606:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc901219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+27:11488:x1875041451062528:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 172us (276us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788179155.739618:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:3.0:1788179155.743127:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179155.743288:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451062784 00000100:00100000:1.0:1788179155.743297:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451062784 00000100:00100000:1.0:1788179155.743346:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 181 00000100:00100000:1.0:1788179155.743354:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+27:11488:x1875041451062784:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788179155.743448:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+27:11488:x1875041451062784:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 95us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179155.743452:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 181 00000100:00100000:0.0:1788179155.745057:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179155.745132:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451062912 00000100:00100000:1.0:1788179155.745140:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451062912 00000100:00100000:1.0:1788179155.745175:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 182 00000100:00100000:1.0:1788179155.745181:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90121bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+27:11488:x1875041451062912:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788179155.745193:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179155.745209:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c499649 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662248 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179155.745333:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499650 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179155.745344:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499650 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179155.745352:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499650 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788179155.745382:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788179155.745394:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499650 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179155.745424:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c499649 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662248 expref: 29 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179155.745437:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499650 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662248 expref: 28 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179155.745443:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bc902d54500) 00010000:00010000:1.0:1788179155.745445:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788179155.745447:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc942173e00, rc 0) 00000100:00100000:1.0:1788179155.745481:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90121bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+28:11488:x1875041451062912:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 301us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179155.745486:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 182 00000100:00100000:0.0:1788179155.747382:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179155.747498:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451063040 00000100:00100000:2.0:1788179155.747507:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451063040 00000100:00100000:2.0:1788179155.747596:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 52 00000100:00100000:2.0:1788179155.747606:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90121b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2357:x1875041451063040:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788179155.747620:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179155.747638:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c499657 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466224f expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788179155.747663:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9572d3, blocks: 0x1 00010000:00010000:2.0:1788179155.747679:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=351s v=(0 0) 00010000:00010000:2.0:1788179155.747684:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179155.747693:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c499657 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466224f expref: 8 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.747725:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c499657 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466224f expref: 8 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.747811:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c5000, rc 0) 00000100:00100000:2.0:1788179155.747890:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90121b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2357:x1875041451063040:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 285us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179155.747898:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 52 00000100:00100000:1.0:1788179155.749910:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179155.749951:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451063296 00000100:00100000:3.0:1788179155.749960:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451063296 00000100:00100000:3.0:1788179155.750002:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 183 00000100:00100000:3.0:1788179155.750013:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+28:11488:x1875041451063296:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788179155.750091:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+28:11488:x1875041451063296:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 81us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179155.750097:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 183 00000100:00100000:0.0:1788179155.752262:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179155.752354:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451063424 00000100:00100000:1.0:1788179155.752361:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451063424 00000100:00100000:1.0:1788179155.752402:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 53 00000100:00100000:1.0:1788179155.752409:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc901219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:11488:x1875041451063424:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788179155.752421:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179155.752435:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a2cd2aa/0xaa4c98508c49965e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662256 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179155.752458:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c499657 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466224f expref: 9 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179155.752465:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179155.752468:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179155.752486:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a2cd2aa/0xaa4c98508c49965e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662256 expref: 9 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179155.752518:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c499657 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466224f expref: 9 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179155.752534:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c499657 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466224f expref: 9 pid: 6590 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179155.752547:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a21880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6591:1875041472030976:192.168.202.2@tcp:104: 00000100:00100000:1.0:1788179155.752628:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e8e8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788179155.755626:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179155.755684:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451063552 00000100:00100000:2.0:1788179155.755691:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451063552 00010000:00010000:2.0:1788179155.755742:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c499657 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466224f expref: 10 pid: 6590 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179155.755749:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a21880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6591:1875041472030976:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788179155.755777:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006a2cd2aa/0xaa4c98508c49965e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662256 expref: 10 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179155.755795:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc942172400, rc 0) 00000100:00100000:2.0:1788179155.755814:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 70 00000100:00100000:2.0:1788179155.755825:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc901219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+10:2356:x1875041451063552:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788179155.755839:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788179155.755878:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc901219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+10:11488:x1875041451063424:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 3441us (3594us total) trans 0 rc 0/0 00010000:00010000:2.0:1788179155.755883:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c499657 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466224f expref: 10 pid: 6590 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179155.755893:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 53 00010000:00010000:2.0:1788179155.755898:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c499657 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466224f expref: 10 pid: 6590 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.755915:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c499657 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466224f expref: 9 pid: 6590 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.755926:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179155.755939:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179155.755945:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006a2cd2aa/0xaa4c98508c49965e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662256 expref: 8 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.755953:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a2cd2aa/0xaa4c98508c49965e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662256 expref: 8 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.755977:0:5782:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006a2cd2aa/0xaa4c98508c49965e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662256 expref: 8 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179155.755986:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935496d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5782:1875041472031104:192.168.202.2@tcp:105: 00000100:00100000:2.0:1788179155.756033:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9051da6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788179155.758758:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935496d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5782:1875041472031104:192.168.202.2@tcp:105: 00010000:00010000:2.0:1788179155.758777:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788179155.758833:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc901219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2356:x1875041451063552:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 3009us (3215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179155.758842:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 70 00000100:00100000:3.0:1788179155.761386:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179155.761459:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451063680 00000100:00100000:0.0:1788179155.761483:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451063680 00002000:00100000:0.0:1788179155.761530:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9bc93b6a5c00 x1875041451063680/t0(0) o4->334bb25c-6762-4beb-8a84-3a838cbc7e80@192.168.202.2@tcp:171/0 lens 504/0 e 0 to 0 dl 1788179166 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788179155.761541:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bc93b6a5c00 with x1875041451063680 ext(0->8) 00002000:00010000:0.0:1788179155.761546:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bc93b6a5c00 00000100:00100000:0.0:1788179155.761582:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:0.0:1788179155.761592:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2357:x1875041451063680:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788179155.762448:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+10:2357:x1875041451063680:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 Request processed in 855us (1069us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788179155.762457:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 4 00002000:00100000:0.0:1788179155.762464:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9bc93b6a5c00 x1875041451063680/t4294967314(0) o4->334bb25c-6762-4beb-8a84-3a838cbc7e80@192.168.202.2@tcp:171/0 lens 504/448 e 0 to 0 dl 1788179166 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788179155.762472:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bc93b6a5c00 with x1875041451063680 ext(0->8) 00002000:00010000:0.0:1788179155.762476:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bc93b6a5c00 00000100:00100000:1.0:1788179155.764174:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179155.764215:0:12275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451063808 00000100:00100000:2.0:1788179155.764224:0:12275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451063808 00000100:00100000:2.0:1788179155.764261:0:12275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 184 00000100:00100000:2.0:1788179155.764267:0:12275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+28:11488:x1875041451063808:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788179155.791107:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000020:00080000:0.0:1788179155.791135:0:5818:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:0.0:1788179155.791157:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:0.0:1788179155.791165:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:3.0:1788179155.791188:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1788179155.791203:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788179155.791405:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788179155.791425:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472031232:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788179155.791491:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179155.791582:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472031232 00000100:00100000:1.0:1788179155.791590:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472031232 00000100:00100000:1.0:1788179155.791654:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788179155.791663:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472031232:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788179155.791830:0:7778:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788179155.791834:0:7778:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788179155 00002000:00010000:1.0:1788179155.791866:0:7778:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788179155.791868:0:7778:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788179155 -> 1788179155 00002000:00010000:1.0:1788179155.791870:0:7778:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:3.0:1788179155.791985:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788179155.792038:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1875041472031232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 375us (545us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788179155.792046:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:3.0:1788179155.792130:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bc935a21500/2, rc 0, transno 4294967315 00000100:00100000:3.0:1788179155.792136:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472031232:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788179155.792539:0:12275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+18:11488:x1875041451063808:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 Request processed in 28268us (28368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179155.792548:0:12275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 184 00000100:00100000:3.0:1788179155.794068:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179155.794334:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451063936 00000100:00100000:2.0:1788179155.794343:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451063936 00000100:00100000:2.0:1788179155.794442:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:2.0:1788179155.794452:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+10:2356:x1875041451063936:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788179155.844493:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:1.0:1788179155.844515:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:2.0:1788179155.844628:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2356:x1875041451063936:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 Request processed in 50170us (50557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179155.845020:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:3.0:1788179155.847238:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179155.847401:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451064192 00000100:00100000:1.0:1788179155.847422:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451064192 00000100:00100000:1.0:1788179155.847473:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 185 00000100:00100000:1.0:1788179155.847482:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+18:11488:x1875041451064192:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788179155.847535:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788179155.847561:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499650 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662248 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179155.847985:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bc902d54500) 00010000:00010000:1.0:1788179155.847991:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788179155.848020:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172200/0xaa4c98508c499665 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179155.848034:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172200/0xaa4c98508c499665 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179155.848043:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172200/0xaa4c98508c499665 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788179155.848295:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001095fe4d reply state 000000006119febe transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172200/0xaa4c98508c499665 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179155.848322:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788179155.848423:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+19:11488:x1875041451064192:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 940us (1193us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788179155.848430:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 185 00010000:00010000:3.0:1788179155.852845:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172200/0xaa4c98508c499665 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.852901:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172200/0xaa4c98508c499665 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.852928:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172200/0xaa4c98508c499665 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.852934:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc942172200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179155.852939:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172200/0xaa4c98508c499665 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.852946:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172200/0xaa4c98508c499665 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.852962:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bc902d54500) 00010000:00010000:3.0:1788179155.852965:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179155.852969:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172200/0xaa4c98508c499665 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.852975:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172200/0xaa4c98508c499665 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179155.854498:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179155.854764:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451064320 00000100:00100000:1.0:1788179155.854774:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451064320 00000100:00100000:1.0:1788179155.854835:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 56 00000100:00100000:1.0:1788179155.854844:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2356:x1875041451064320:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788179155.855093:0:7778:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788179155.855097:0:7778:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788179155 -> 1788179153 00002000:00010000:1.0:1788179155.855100:0:7778:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788179152 00002000:00010000:1.0:1788179155.855102:0:7778:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788179155 -> 1788179153 00002000:00010000:1.0:1788179155.855104:0:7778:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788179155.855154:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2356:x1875041451064320:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 311us (663us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788179155.855161:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 56 00000100:00100000:1.0:1788179155.869476:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179155.871722:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451064576 00000100:00100000:3.0:1788179155.871738:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451064576 00000100:00100000:2.0:1788179155.871978:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 186 00000100:00100000:2.0:1788179155.871989:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+18:11488:x1875041451064576:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788179155.872057:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c49966c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.872094:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499634 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466223a expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.872104:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c49966c lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.872140:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499634 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466223a expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.872154:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499634 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466223a expref: 18 pid: 5827 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179155.872169:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935496d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1875041472031360:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788179155.872270:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc909982480 going to sleep for 11 seconds 00000100:00100000:3.0:1788179155.883373:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179155.883483:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451064704 00000100:00100000:0.0:1788179155.883507:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451064704 00010000:00010000:0.0:1788179155.883550:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499634 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466223a expref: 19 pid: 5827 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179155.883603:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 71 00000100:00100000:0.0:1788179155.883614:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+19:2357:x1875041451064704:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179155.883637:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179155.883662:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499634 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466223a expref: 19 pid: 5827 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.883675:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499634 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466223a expref: 19 pid: 5827 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.883696:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bc902d54500) 00010000:00010000:0.0:1788179155.883701:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c49966c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.883722:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c49966c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.883730:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c49966c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.883747:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179155.883800:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+19:2357:x1875041451064704:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 189us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179155.883808:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 71 00010000:00010000:2.0:1788179155.884895:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499634 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466223a expref: 18 pid: 5827 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179155.884914:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935496d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1875041472031360:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788179155.884936:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c49966c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.884947:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c49966c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.884953:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c49966c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.884983:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c49966c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.885000:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c49966c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.885007:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c49966c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.885013:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179155.885018:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c49966c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.885024:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c49966c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.885036:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bc902d54500) 00010000:00010000:2.0:1788179155.885039:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788179155.885042:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c49966c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.885047:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c49966c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179155.885149:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+17:11488:x1875041451064576:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 Request processed in 13161us (15682us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788179155.885167:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 186 00000100:00100000:3.0:1788179155.904146:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179155.904220:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451064832 00000100:00100000:1.0:1788179155.904230:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451064832 00000100:00100000:1.0:1788179155.904297:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00100000:1.0:1788179155.904308:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2355:x1875041451064832:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788179155.904352:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000029ddc449/0xaa4c98508c499673 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179155.904373:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006a2cd2aa/0xaa4c98508c49965e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662256 expref: 8 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179155.904396:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179155.904400:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788179155.904975:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029ddc449/0xaa4c98508c499673 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.908471:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006a2cd2aa/0xaa4c98508c49965e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662256 expref: 8 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.908497:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006a2cd2aa/0xaa4c98508c49965e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662256 expref: 8 pid: 6591 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179155.908516:0:6591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc90121ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6591:1875041472031488:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788179155.908631:0:6591:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9111850c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788179155.914348:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179155.914383:0:6591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc90121ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6591:1875041472031488:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788179155.914429:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000029ddc449/0xaa4c98508c499673 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179155.915235:0:11517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451064960 00000100:00100000:1.0:1788179155.915244:0:11517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451064960 00010000:00010000:1.0:1788179155.915278:0:11517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006a2cd2aa/0xaa4c98508c49965e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662256 expref: 9 pid: 6591 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179155.915315:0:11517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 72 00000100:00100000:1.0:1788179155.915326:0:11517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+9:2357:x1875041451064960:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788179155.915342:0:11517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788179155.915362:0:11517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006a2cd2aa/0xaa4c98508c49965e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662256 expref: 9 pid: 6591 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179155.915374:0:11517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006a2cd2aa/0xaa4c98508c49965e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662256 expref: 9 pid: 6591 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179155.915555:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a2cd2aa/0xaa4c98508c49965e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662256 expref: 9 pid: 6591 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179155.915728:0:11517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788179155.915733:0:11517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788179155.915738:0:11517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000029ddc449/0xaa4c98508c499673 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179155.915757:0:11517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029ddc449/0xaa4c98508c499673 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179155.915845:0:11517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788179155.915868:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000029ddc449/0xaa4c98508c499673 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.915877:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029ddc449/0xaa4c98508c499673 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.915899:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000029ddc449/0xaa4c98508c499673 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.915905:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029ddc449/0xaa4c98508c499673 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.915910:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029ddc449/0xaa4c98508c499673 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.915915:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc942173e00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179155.915918:0:6591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029ddc449/0xaa4c98508c499673 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.915924:0:6591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029ddc449/0xaa4c98508c499673 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.915932:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029ddc449/0xaa4c98508c499673 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.915942:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029ddc449/0xaa4c98508c499673 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179155.915977:0:11517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2357:x1875041451064960:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 651us (1637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179155.915987:0:11517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 72 00000100:00100000:0.0:1788179155.915991:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2355:x1875041451064832:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 Request processed in 11684us (11852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179155.915998:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00100000:2.0:1788179155.926289:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179155.926728:0:12275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451065216 00000100:00100000:3.0:1788179155.926739:0:12275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451065216 00000100:00100000:3.0:1788179155.926963:0:12275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 187 00000100:00100000:3.0:1788179155.926974:0:12275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+17:11488:x1875041451065216:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788179155.927062:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c49967a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.927093:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c49967a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.927104:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c49967a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.927332:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499681 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.927344:0:12275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c499642 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662241 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.927351:0:12275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499681 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.927383:0:12275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c499642 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662241 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.927567:0:12275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c499642 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662241 expref: 18 pid: 5797 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179155.927594:0:12275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b6a5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12275:1875041472031616:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788179155.928209:0:12275:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9359ea180 going to sleep for 11 seconds 00000100:00100000:2.0:1788179155.937157:0:12275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b6a5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12275:1875041472031616:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788179155.937183:0:12275:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499681 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179155.939242:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179155.939331:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451065344 00000100:00100000:0.0:1788179155.939340:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451065344 00010000:00010000:0.0:1788179155.939375:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c499642 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662241 expref: 19 pid: 5797 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179155.939426:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 73 00000100:00100000:0.0:1788179155.939435:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b612d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+19:2356:x1875041451065344:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179155.939457:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179155.939464:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c499642 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662241 expref: 19 pid: 5797 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.939476:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c499642 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662241 expref: 19 pid: 5797 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.939818:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c499642 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662241 expref: 19 pid: 5797 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.939834:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bc902d54500) 00010000:00010000:0.0:1788179155.939839:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499681 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.939907:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499681 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.939914:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499681 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.939944:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179155.939987:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b612d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+18:2356:x1875041451065344:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 553us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179155.939995:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 73 00010000:00010000:3.0:1788179155.941107:0:12275:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499681 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.941117:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499681 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788179155.941287:0:12275:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1788179155.941461:0:12275:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1788179155.941514:0:12275:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1788179155.941603:0:12275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b6a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12275:1875041472031744:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788179155.941665:0:12275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179155.941987:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472031744 00000100:00100000:1.0:1788179155.941995:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472031744 00000100:00100000:1.0:1788179155.942048:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788179155.942057:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12275:x1875041472031744:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788179155.942125:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12275:x1875041472031744:12345-0@lo:1000:mdt00_004.0 Request processed in 70us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179155.942132:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788179155.944170:0:12275:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9359ea180 going to sleep for 11 seconds 00000100:00100000:3.0:1788179155.944200:0:12275:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1788179155.944205:0:12275:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bc935a21500, transno 4294967315 00000100:00100000:3.0:1788179155.944228:0:12275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b6a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12275:1875041472031744:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1788179155.946141:0:12275:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1788179155.946217:0:12275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b6a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12275:1875041472031872:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788179155.946279:0:12275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179155.946396:0:12275:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9359ea6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788179155.950800:0:12320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472031872 00000100:00100000:2.0:1788179155.950812:0:12320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472031872 00000100:00100000:2.0:1788179155.950933:0:12320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788179155.950943:0:12320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:12275:x1875041472031872:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788179155.951189:0:12320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:12275:x1875041472031872:12345-0@lo:1000:mdt00_004.0 Request processed in 247us (4908us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788179155.951196:0:12320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788179155.951276:0:12275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b6a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12275:1875041472031872:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1788179155.951311:0:12275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499681 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.951321:0:12275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499681 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.951328:0:12275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499681 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.951334:0:12275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5e00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179155.951338:0:12275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499681 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.951346:0:12275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499681 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.951372:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bc902d54500) 00010000:00010000:3.0:1788179155.951375:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788179155.951379:0:12275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499681 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.951386:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499681 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.951410:0:12275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4995bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.951416:0:12275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4995bd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.951421:0:12275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4995bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.951426:0:12275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5a00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179155.951429:0:12275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4995bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.951435:0:12275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4995bd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.951441:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc902d54200) 00010000:00010000:3.0:1788179155.951443:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788179155.951446:0:12275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4995bd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.951451:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4995bd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.951479:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499688 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.951492:0:12275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4995d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662225 expref: 21 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.951502:0:12275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499688 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.951530:0:12275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4995d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662225 expref: 21 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179155.951543:0:12275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4995d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662225 expref: 21 pid: 5797 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179155.951555:0:12275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b6a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12275:1875041472032000:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788179155.951630:0:12275:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9359ea6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788179155.956760:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179155.956977:0:12275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b6a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12275:1875041472032000:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788179155.957003:0:12275:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499688 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179155.957591:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451065472 00000100:00100000:2.0:1788179155.957599:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451065472 00010000:00010000:2.0:1788179155.960076:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4995d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662225 expref: 22 pid: 5797 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179155.960124:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 74 00000100:00100000:2.0:1788179155.960139:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+22:2356:x1875041451065472:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788179155.960155:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179155.960162:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4995d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662225 expref: 22 pid: 5797 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.960175:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4995d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662225 expref: 22 pid: 5797 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.960197:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4995d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662225 expref: 22 pid: 5797 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.960213:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc902d54200) 00010000:00010000:2.0:1788179155.960231:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499688 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.960241:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499688 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.960248:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499688 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.960281:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788179155.960336:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+21:2356:x1875041451065472:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 203us (3584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179155.960344:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 74 00010000:00010000:0.0:1788179155.961615:0:12275:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499688 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.961636:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499688 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.961649:0:12275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499688 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.961656:0:12275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499688 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.961662:0:12275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499688 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.961668:0:12275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4800 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179155.961682:0:12275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499688 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.961698:0:12275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499688 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.961725:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc902d54200) 00010000:00010000:0.0:1788179155.961728:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179155.961733:0:12275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499688 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.961739:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499688 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.961753:0:12275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c49967a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.961760:0:12275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c49967a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.961766:0:12275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c49967a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.961771:0:12275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179155.961774:0:12275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c49967a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.961782:0:12275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c49967a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.961789:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc902d54200) 00010000:00010000:0.0:1788179155.961791:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788179155.961801:0:12275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c49967a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179155.961807:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c49967a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179155.962070:0:12275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+20:11488:x1875041451065216:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 35097us (35789us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1788179155.962080:0:12275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 187 00000020:00080000:0.0:1788179155.962085:0:12275:0:(tgt_main.c:811:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788179155.962510:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788179155.962515:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788179155.963274:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788179155.963284:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788179155.975004:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179155.975116:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451065728 00000100:00100000:2.0:1788179155.975127:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451065728 00000100:00100000:2.0:1788179155.975190:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 50 00000100:00100000:2.0:1788179155.975200:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9266fc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+20:11488:x1875041451065728:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788179155.975931:0:5799:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788179155.976030:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1788179155.976077:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c49968f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.976093:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c49968f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.976104:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c49968f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.976112:0:5799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c49968f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.976129:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c49968f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.976135:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c49968f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179155.976150:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788179155.976246:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9266fc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+22:11488:x1875041451065728:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 1047us (1252us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1788179155.976254:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 50 00000020:00080000:2.0:1788179155.976258:0:5799:0:(tgt_main.c:811:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788179155.976715:0:6605:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788179155.976723:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c49968f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179155.976731:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c4600 already unused, calling callback (ffffffffc1644220) 00010000:00010000:1.0:1788179155.976735:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c49968f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179155.976743:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c49968f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179155.976763:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9bc909481300) 00010000:00010000:1.0:1788179155.976766:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788179155.976771:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c49968f lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179155.976777:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c49968f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179155.976808:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179155.976810:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179155.976811:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179156.224185:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179156.674111:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788179156.674139:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b6a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472032128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788179156.674215:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179156.674286:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472032128 00000100:00100000:3.0:1788179156.674294:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472032128 00000100:00100000:3.0:1788179156.674341:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788179156.674348:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a43e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875041472032128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788179156.674384:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1788179156.674421:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a43e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875041472032128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179156.674429:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788179156.674649:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b6a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472032128:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788179156.997256:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788179156.997265:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788179156.997452:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788179156.997460:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788179157.253121:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788179157.376786:0:12414:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788179157.376796:0:12414:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788179157.376972:0:12414:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788179157.376978:0:12414:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788179157.499086:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179157.509406:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451065984 00000100:00100000:1.0:1788179157.509431:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451065984 00000100:00100000:1.0:1788179157.509553:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 188 00000100:00100000:1.0:1788179157.509566:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+22:11505:x1875041451065984:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788179157.509597:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179157.509621:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c499696 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466225d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179157.510019:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172200/0xaa4c98508c49969d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179157.510036:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172200/0xaa4c98508c49969d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179157.510060:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172200/0xaa4c98508c49969d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788179157.510078:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1788179157.510289:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c499696 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466225d expref: 25 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179157.510309:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172200/0xaa4c98508c49969d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466225d expref: 24 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179157.510318:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:1.0:1788179157.510321:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788179157.510325:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc942172200, rc 0) 00000100:00100000:1.0:1788179157.510406:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+24:11505:x1875041451065984:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 843us (11326us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1788179157.510414:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 188 00000100:00080000:0.0:1788179157.512241:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788179157.518233:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179157.518658:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451066112 00000100:00100000:3.0:1788179157.518669:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451066112 00000100:00100000:3.0:1788179157.518748:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 189 00000100:00100000:3.0:1788179157.518770:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+24:11505:x1875041451066112:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:3.0:1788179157.518892:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4996ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.518912:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4996ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.518924:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4996ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.518938:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4996b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.518945:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4996b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.518951:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4996b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.519246:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4996b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.519266:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4996b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.519274:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4996b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788179157.519318:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4996b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.519331:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4996ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.519338:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4996ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.519344:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4996ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.519351:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5a00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179157.519355:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4996ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.519362:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4996ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.519373:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:3.0:1788179157.519377:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179157.519381:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4996ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.519387:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4996ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.519405:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4996b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.519411:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4996b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.519415:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4996b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.519420:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5e00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179157.519422:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4996b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.519428:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4996b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.519435:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bc902d54500) 00010000:00010000:3.0:1788179157.519437:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179157.519441:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4996b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.519447:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4996b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.519462:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4996b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.519469:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4996b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.519474:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4996b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.519484:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179157.519487:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4996b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.519510:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4996b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.519519:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:3.0:1788179157.519520:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179157.519523:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4996b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.519528:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4996b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179157.519615:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+24:11505:x1875041451066112:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 857us (1391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179157.519624:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 189 00000100:00100000:3.0:1788179157.580267:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179157.580308:0:12275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451066368 00000100:00100000:3.0:1788179157.580318:0:12275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451066368 00000100:00100000:3.0:1788179157.580371:0:12275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 190 00000100:00100000:3.0:1788179157.580381:0:12275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+24:11508:x1875041451066368:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1788179157.580402:0:12275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179157.580424:0:12275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c4996c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662264 expref: -99 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.580499:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4996c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.580526:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4996c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.580539:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4996c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.580556:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4996ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.580563:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4996ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.580570:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4996ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.580966:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4996d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.580976:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4996d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.580984:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4996d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179157.580993:0:12275:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788179157.581096:0:12275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4996c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.581104:0:12275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4996c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.581109:0:12275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4996c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.581121:0:12275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179157.581126:0:12275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4996c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.581133:0:12275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4996c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.581145:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:3.0:1788179157.581148:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179157.581152:0:12275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4996c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.581158:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4996c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.581168:0:12275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4996ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.581174:0:12275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4996ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.581180:0:12275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4996ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.581184:0:12275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5e00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179157.581186:0:12275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4996ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.581191:0:12275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4996ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.581208:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bc902d54d00) 00010000:00010000:3.0:1788179157.581211:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179157.581214:0:12275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4996ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.581219:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4996ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.581260:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c4996c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662264 expref: 27 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.581273:0:12275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4996d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662264 expref: 26 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.581280:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc902d54500) 00010000:00010000:3.0:1788179157.581282:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788179157.581285:0:12275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b5a00, rc 0) 00000100:00100000:3.0:1788179157.581344:0:12275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+26:11508:x1875041451066368:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 965us (1087us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788179157.581351:0:12275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 190 00000100:00100000:3.0:1788179157.592256:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179157.592342:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451066496 00000100:00100000:3.0:1788179157.592352:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451066496 00000100:00100000:3.0:1788179157.592401:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 191 00000100:00100000:3.0:1788179157.592411:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+26:11508:x1875041451066496:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:3.0:1788179157.592472:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c4996e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.592500:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c4996e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.592511:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c4996e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.592536:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c4996e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.592544:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c4996e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.592553:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c4996e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.592559:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179157.592563:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c4996e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.592570:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c4996e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.592581:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc902d54500) 00010000:00010000:3.0:1788179157.592584:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788179157.592589:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c4996e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.592595:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c4996e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179157.592660:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+26:11508:x1875041451066496:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 250us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179157.593888:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 191 00000100:00100000:3.0:1788179157.601511:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179157.601551:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451066752 00000100:00100000:3.0:1788179157.601560:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451066752 00000100:00100000:3.0:1788179157.601613:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:3.0:1788179157.601624:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+26:11508:x1875041451066752:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:3.0:1788179157.601886:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+27:11508:x1875041451066752:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 263us (385us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788179157.601894:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:3.0:1788179157.660990:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179157.663338:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451067008 00000100:00100000:1.0:1788179157.663353:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451067008 00000100:00100000:1.0:1788179157.663422:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 192 00000100:00100000:1.0:1788179157.663432:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+27:11034:x1875041451067008:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:1.0:1788179157.663455:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179157.663477:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c4996ea lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466226b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179157.663578:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c4996f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179157.663622:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4996d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662264 expref: 28 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179157.663632:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c4996f1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179157.663664:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4996d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662264 expref: 28 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179157.663678:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4996d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662264 expref: 28 pid: 12275 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179157.663702:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a20700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5827:1875041472032256:192.168.202.2@tcp:104: 00000100:00100000:1.0:1788179157.663934:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc902ea6780 going to sleep for 11 seconds 00000100:00100000:3.0:1788179157.666454:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179157.666544:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451067136 00000100:00100000:2.0:1788179157.666553:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451067136 00010000:00010000:2.0:1788179157.666606:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4996d5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662264 expref: 29 pid: 12275 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179157.666753:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a20700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5827:1875041472032256:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788179157.666777:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c4996f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179157.667146:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 75 00000100:00100000:2.0:1788179157.667158:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+29:2357:x1875041451067136:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788179157.667172:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179157.667179:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4996d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662264 expref: 29 pid: 12275 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179157.667192:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4996d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662264 expref: 29 pid: 12275 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179157.667224:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c4996d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662264 expref: 29 pid: 12275 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179157.667238:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc902d54500) 00010000:00010000:2.0:1788179157.667242:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c4996f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179157.667252:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c4996f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179157.667260:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c4996f1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179157.667277:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788179157.667329:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+28:2357:x1875041451067136:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 173us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179157.667336:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 75 00010000:00010000:1.0:1788179157.667384:0:5827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c4996f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179157.667391:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c4996f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788179157.667409:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788179157.667544:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172e00/0xaa4c98508c4996ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466226b expref: 29 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179157.667572:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c4996f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466226b expref: 28 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179157.667580:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc902d54500) 00010000:00010000:1.0:1788179157.667583:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788179157.667586:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc942172400, rc 0) 00000100:00100000:1.0:1788179157.667610:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+28:11034:x1875041451067008:12345-192.168.202.2@tcp:101:bash.0 Request processed in 4180us (6773us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788179157.667618:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 192 00000100:00100000:2.0:1788179157.670921:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179157.670993:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451067392 00000100:00100000:3.0:1788179157.671004:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451067392 00000100:00100000:3.0:1788179157.671091:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 193 00000100:00100000:3.0:1788179157.671102:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+28:11034:x1875041451067392:12345-192.168.202.2@tcp:36:bash.0 00010000:00010000:3.0:1788179157.671360:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c4996ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.671378:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c4996ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.671389:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c4996ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788179157.671438:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1788179157.671461:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a351c29f reply state 00000000c70a7693 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c4996ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179157.671487:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788179157.671568:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1788179157.671662:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+32:11034:x1875041451067392:12345-192.168.202.2@tcp:36:bash.0 Request processed in 561us (816us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1788179157.671670:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 193 00000020:00080000:3.0:1788179157.671674:0:5798:0:(tgt_main.c:811:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1788179157.673807:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c4996ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179157.673822:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c4996ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179157.673829:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c4996ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179157.673835:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4c00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179157.673839:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c4996ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179157.674103:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00010000:00010000:0.0:1788179157.674242:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c4996ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179157.674262:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc902d54500) 00010000:00010000:0.0:1788179157.674266:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179157.674270:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c4996ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179157.674276:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c4996ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179157.674530:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451067520 00000100:00100000:3.0:1788179157.674539:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451067520 00000100:00100000:3.0:1788179157.675005:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 194 00000100:00100000:3.0:1788179157.675017:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e6be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+31:11034:x1875041451067520:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:3.0:1788179157.675039:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179157.675056:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c499706 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662272 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.675114:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c499706 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662272 expref: 32 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.675127:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c499706 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662272 expref: 32 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.675144:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc902d54500) 00010000:00010000:3.0:1788179157.675147:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788179157.675149:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b5000, rc 0) 00000100:00100000:3.0:1788179157.675212:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e6be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+32:11034:x1875041451067520:12345-192.168.202.2@tcp:101:bash.0 Request processed in 198us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179157.675219:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 194 00000100:00100000:0.0:1788179157.678360:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179157.678424:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451067648 00000100:00100000:1.0:1788179157.678435:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451067648 00000100:00100000:1.0:1788179157.678504:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 58 00000100:00100000:1.0:1788179157.678515:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90121ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:11034:x1875041451067648:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:1.0:1788179157.678532:0:7778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179157.678552:0:7778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044300061/0xaa4c98508c49970d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662279 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788179157.678577:0:7778:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9572d1, atime: 0x6a9572d0, ctime: 0x6a9572d1, blocks: 0xb 00000100:00080000:0.0:1788179157.679952:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788179157.680020:0:7778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=353s v=(0 0) 00010000:00010000:1.0:1788179157.680026:0:7778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179157.680036:0:7778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044300061/0xaa4c98508c49970d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662279 expref: 8 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179157.680054:0:7778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000044300061/0xaa4c98508c49970d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662279 expref: 8 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179157.680091:0:7778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc942172e00, rc 0) 00000100:00100000:1.0:1788179157.680153:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90121ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:11034:x1875041451067648:12345-192.168.202.2@tcp:101:bash.0 Request processed in 1640us (1801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179157.680161:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 58 00000100:00100000:1.0:1788179157.682011:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179157.682085:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451067776 00000100:00100000:2.0:1788179157.682093:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451067776 00002000:00010000:2.0:1788179157.682134:0:6597:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788179157.682140:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bc935a20700 with x1875041451067776 ext(0->18446744073709551615) 00002000:00010000:2.0:1788179157.682151:0:6597:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bc935a20700. 00000100:00100000:2.0:1788179157.682182:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:2.0:1788179157.682192:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2355:x1875041451067776:12345-192.168.202.2@tcp:10:bash.0 00002000:00010000:2.0:1788179157.682447:0:6597:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788179157.682461:0:6597:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788179153 -> 1788179156 00002000:00010000:2.0:1788179157.682464:0:6597:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788179152 -> 1788179152 00002000:00010000:2.0:1788179157.682466:0:6597:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788179153 -> 1788179156 00002000:00010000:2.0:1788179157.682468:0:6597:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788179157.682524:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+9:2355:x1875041451067776:12345-192.168.202.2@tcp:10:bash.0 Request processed in 333us (518us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788179157.682530:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 5 00002000:00010000:2.0:1788179157.682534:0:6597:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788179157.682537:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bc935a20700 with x1875041451067776 ext(0->18446744073709551615) 00002000:00010000:2.0:1788179157.682541:0:6597:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bc935a20700. 00000100:00100000:0.0:1788179157.698429:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93abbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041472032384:0@lo:400:kworker.0 00000100:00100000:0.0:1788179157.698540:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179157.698760:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472032384 00000100:00100000:1.0:1788179157.698770:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472032384 00000100:00100000:1.0:1788179157.698833:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788179157.698843:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:3306:x1875041472032384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179157.699098:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b5ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472032768:0@lo:400:kworker.0 00000100:00100000:2.0:1788179157.699132:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179157.699174:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472032768 00000100:00100000:2.0:1788179157.699178:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472032768 00000100:00100000:2.0:1788179157.699221:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788179157.699227:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875041472032768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179157.699263:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875041472032768:12345-0@lo:400:kworker.0 Request processed in 37us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179157.699271:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1788179157.699297:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788179157.699329:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b5ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472032768:0@lo:400:kworker.0 00000100:00100000:1.0:1788179157.699423:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:3306:x1875041472032384:12345-0@lo:400:kworker.0 Request processed in 581us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179157.699431:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1788179157.699730:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788179157.699780:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f82d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041472032512:0@lo:400:kworker.0 00000100:00100000:3.0:1788179157.699817:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179157.699872:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b5a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472033024:0@lo:400:kworker.0 00000100:00100000:3.0:1788179157.699897:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179157.699918:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788179157.699923:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f82df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875041472032640:0@lo:400:kworker.0 00000100:00100000:3.0:1788179157.699947:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179157.699976:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472033024 00000100:00100000:3.0:1788179157.699981:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472033024 00000100:00100000:3.0:1788179157.700016:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788179157.700023:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875041472033024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179157.700065:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875041472033024:12345-0@lo:400:kworker.0 Request processed in 43us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179157.700071:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788179157.700099:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b5a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472033024:0@lo:400:kworker.0 00000100:00080000:3.0:1788179157.700115:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788179157.700125:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472032512 00000100:00100000:3.0:1788179157.700129:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472032512 00000100:00100000:3.0:1788179157.700151:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472032640 00000100:00100000:3.0:1788179157.700154:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472032640 00000100:00100000:3.0:1788179157.700179:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788179157.700184:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041472032512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179157.700221:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041472032512:12345-0@lo:400:kworker.0 Request processed in 35us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179157.700226:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788179157.700236:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788179157.700242:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875041472032640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179157.700289:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875041472032640:12345-0@lo:400:kworker.0 Request processed in 47us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179157.700295:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788179157.700319:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f82df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875041472032640:0@lo:400:kworker.0 00000100:00100000:3.0:1788179157.700329:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f82d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041472032512:0@lo:400:kworker.0 00000100:00080000:3.0:1788179157.700348:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788179157.700844:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b5a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875041472032896:0@lo:400:kworker.0 00000100:00100000:2.0:1788179157.700903:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179157.701023:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472032896 00000100:00100000:3.0:1788179157.701028:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472032896 00000100:00100000:3.0:1788179157.701077:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788179157.701084:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875041472032896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179157.701121:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875041472032896:12345-0@lo:400:kworker.0 Request processed in 37us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179157.701127:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:2.0:1788179157.701216:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788179157.701239:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b5a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875041472032896:0@lo:400:kworker.0 00000100:00100000:0.0:1788179157.701325:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93abbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041472032384:0@lo:400:kworker.0 00000100:00100000:2.0:1788179157.809511:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179157.809887:0:12275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451067904 00000100:00100000:3.0:1788179157.809897:0:12275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451067904 00000100:00100000:3.0:1788179157.809951:0:12275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 195 00000100:00100000:3.0:1788179157.809961:0:12275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+32:11522:x1875041451067904:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:3.0:1788179157.810033:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499714 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810049:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499714 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810061:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499714 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810075:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c49971b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810095:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c49971b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810101:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c49971b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810373:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499722 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810383:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810391:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788179157.810439:0:12275:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810450:0:12275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499714 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810457:0:12275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499714 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810464:0:12275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499714 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810470:0:12275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5e00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179157.810474:0:12275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499714 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810481:0:12275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499714 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810502:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:3.0:1788179157.810505:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179157.810510:0:12275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499714 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810516:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499714 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810527:0:12275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c49971b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810533:0:12275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c49971b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810539:0:12275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c49971b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810544:0:12275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179157.810547:0:12275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c49971b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810554:0:12275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c49971b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810561:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bc902d54d00) 00010000:00010000:3.0:1788179157.810563:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179157.810566:0:12275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c49971b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810572:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c49971b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810595:0:12275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810615:0:12275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499722 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810622:0:12275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499722 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810627:0:12275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4c00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179157.810630:0:12275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499722 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810636:0:12275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499722 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810643:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc902d54500) 00010000:00010000:3.0:1788179157.810646:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179157.810649:0:12275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499722 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.810654:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499722 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179157.810738:0:12275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+32:11522:x1875041451067904:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 778us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179157.810746:0:12275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 195 00000100:00100000:1.0:1788179157.851236:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179157.851326:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451068160 00000100:00100000:3.0:1788179157.851338:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451068160 00000100:00100000:3.0:1788179157.851402:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 196 00000100:00100000:3.0:1788179157.851427:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+32:11525:x1875041451068160:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1788179157.851449:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179157.851470:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499729 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662280 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.851539:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499730 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.851553:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499730 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.851563:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499730 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.851607:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499737 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.851615:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.851622:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.851980:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c49973e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.851990:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c49973e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.851997:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c49973e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179157.852016:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788179157.852125:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499730 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.852132:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499730 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.852138:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499730 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.852144:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179157.852148:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499730 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.852155:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499730 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.852167:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:3.0:1788179157.852170:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179157.852173:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499730 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.852179:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499730 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.852191:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.852198:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499737 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.852212:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499737 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.852217:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5e00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179157.852220:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499737 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.852226:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499737 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.852234:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bc902d54d00) 00010000:00010000:3.0:1788179157.852236:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179157.852239:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499737 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.852243:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499737 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.852287:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499729 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662280 expref: 35 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.852300:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c49973e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662280 expref: 34 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.852306:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc902d54500) 00010000:00010000:3.0:1788179157.852308:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788179157.852310:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b5a00, rc 0) 00000100:00100000:3.0:1788179157.852375:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+34:11525:x1875041451068160:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 950us (1147us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1788179157.852390:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 196 00000100:00100000:1.0:1788179157.878460:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179157.878548:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451068288 00000100:00100000:3.0:1788179157.878558:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451068288 00000100:00100000:3.0:1788179157.878630:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 197 00000100:00100000:3.0:1788179157.878640:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+34:11525:x1875041451068288:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:3.0:1788179157.878719:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49974c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.878737:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c4996f1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466226b expref: 34 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.878747:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49974c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.878781:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c4996f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466226b expref: 34 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.878796:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c4996f1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466226b expref: 34 pid: 5827 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179157.878810:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f6df800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1875041472033152:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788179157.878932:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc8013bf6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788179157.884312:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f6df800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5796:1875041472033152:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788179157.884340:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49974c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179157.884553:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179157.884897:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451068544 00000100:00100000:3.0:1788179157.884919:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451068544 00000100:00100000:3.0:1788179157.884974:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 52 00000100:00100000:3.0:1788179157.884984:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+35:5569:x1875041451068544:12345-192.168.202.2@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788179157.885361:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+36:5569:x1875041451068544:12345-192.168.202.2@tcp:35:ldlm_bl.0 Request processed in 376us (807us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788179157.885370:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 52 00000100:00100000:0.0:1788179157.893156:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179157.893300:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451068672 00000100:00100000:2.0:1788179157.893312:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451068672 00010000:00010000:2.0:1788179157.893369:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c4996f1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466226b expref: 36 pid: 5827 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179157.893418:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 76 00000100:00100000:2.0:1788179157.893431:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90710fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+36:2356:x1875041451068672:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788179157.893458:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179157.893466:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c4996f1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466226b expref: 36 pid: 5827 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179157.893482:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c4996f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466226b expref: 36 pid: 5827 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179157.893510:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c4996f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466226b expref: 36 pid: 5827 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179157.893532:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc902d54500) 00010000:00010000:2.0:1788179157.893539:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49974c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179157.893550:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49974c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179157.893560:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49974c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179157.893615:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788179157.893727:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90710fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+35:2356:x1875041451068672:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 297us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179157.893735:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 76 00010000:00010000:3.0:1788179157.894455:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49974c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.894469:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49974c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.894524:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49974c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.894533:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49974c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.894541:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49974c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.894549:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4c00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179157.894554:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49974c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.894563:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49974c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.894581:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc902d54500) 00010000:00010000:3.0:1788179157.894585:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788179157.894590:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49974c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179157.894626:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49974c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179157.894710:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+34:11525:x1875041451068288:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 16070us (16257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179157.894720:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 197 00000100:00100000:0.0:1788179157.898297:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179157.898386:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451068928 00000100:00100000:3.0:1788179157.898399:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451068928 00000100:00100000:3.0:1788179157.898474:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 53 00000100:00100000:3.0:1788179157.898488:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc901218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+34:11525:x1875041451068928:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:3.0:1788179157.899096:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc901218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+35:11525:x1875041451068928:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 608us (810us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788179157.899105:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 53 00000100:00100000:0.0:1788179158.049670:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179158.049832:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451069184 00000100:00100000:3.0:1788179158.049844:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451069184 00000100:00100000:3.0:1788179158.049957:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 198 00000100:00100000:3.0:1788179158.049970:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc901218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+35:11536:x1875041451069184:12345-192.168.202.2@tcp:101:cat.0 00010000:00010000:3.0:1788179158.050003:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179158.050030:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499753 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662287 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.050107:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c49975a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.050123:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c49975a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.050154:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c49975a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.050171:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499761 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.050178:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.050186:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.051177:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499768 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.051193:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.051201:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179158.051212:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788179158.051537:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c49975a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.051545:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c49975a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.051710:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c49975a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.051718:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5e00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179158.051804:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c49975a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.051813:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c49975a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.051827:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:3.0:1788179158.051830:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179158.051835:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c49975a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.051843:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c49975a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.051887:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.051894:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499761 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.051900:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499761 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.051905:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179158.051908:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499761 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.051914:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499761 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.052057:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bc902d54d00) 00010000:00010000:3.0:1788179158.052060:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179158.052070:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499761 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.052075:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499761 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.052131:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499753 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662287 expref: 38 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.052145:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499768 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662287 expref: 37 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.052152:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc902d54500) 00010000:00010000:3.0:1788179158.052155:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788179158.052157:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4200, rc 0) 00000100:00100000:3.0:1788179158.052234:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc901218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+37:11536:x1875041451069184:12345-192.168.202.2@tcp:101:cat.0 Request processed in 2265us (2579us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788179158.052242:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 198 00000100:00100000:1.0:1788179158.062390:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179158.062556:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451069440 00000100:00100000:3.0:1788179158.062743:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451069440 00000100:00100000:3.0:1788179158.062832:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 54 00000100:00100000:3.0:1788179158.062845:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+37:11536:x1875041451069440:12345-192.168.202.2@tcp:35:cat.0 00000100:00100000:1.0:1788179158.066175:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+38:11536:x1875041451069440:12345-192.168.202.2@tcp:35:cat.0 Request processed in 3311us (3778us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788179158.066198:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 54 00000100:00100000:0.0:1788179158.108795:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179158.110756:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451069696 00000100:00100000:2.0:1788179158.110771:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451069696 00000100:00100000:2.0:1788179158.110840:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 199 00000100:00100000:2.0:1788179158.110868:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90121aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+38:11537:x1875041451069696:12345-192.168.202.2@tcp:36:rm.0 00010000:00010000:2.0:1788179158.110928:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788179158.110955:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4200/0xaa4c98508c499768 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662287 expref: 38 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.110979:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c49973e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662280 expref: 37 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.110992:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c499706 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662272 expref: 36 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.111000:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc902d54500) 00010000:00010000:2.0:1788179158.111011:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788179158.111030:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499776 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.111042:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499776 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.111051:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499776 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.111063:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c49977d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.111083:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c49977d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.111089:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c49977d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.111418:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499784 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.111427:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499784 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.111434:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499784 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788179158.112679:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1788179158.112700:0:5797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 354175849501ns, next at 355175847011ns, rc = 0 00010000:00010000:2.0:1788179158.112768:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49978b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.112780:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49978b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.112788:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49978b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.112795:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49978b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.112802:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49978b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.112816:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49978b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.113032:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788179158.113055:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499784 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.113062:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499784 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.113068:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499784 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.113074:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c4000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179158.113079:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499784 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.113086:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499784 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.113096:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc909481000) 00010000:00010000:2.0:1788179158.113099:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788179158.113103:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499784 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.113109:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499784 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.113126:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499776 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.113132:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499776 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.113145:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499776 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.113151:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5600 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179158.113154:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499776 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.113160:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499776 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.113168:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:2.0:1788179158.113170:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179158.113173:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499776 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.113178:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c499776 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788179158.113188:0:5797:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000882d2d3c reply state 00000000c8459696 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c49977d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179158.113197:0:5797:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788179158.113288:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90121aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+37:11537:x1875041451069696:12345-192.168.202.2@tcp:36:rm.0 Request processed in 2435us (4499us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788179158.113297:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 199 00010000:00010000:1.0:1788179158.116160:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788179158.116175:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49978b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.116191:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5e00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:1.0:1788179158.116194:0:6606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49978b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.116226:0:6606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49978b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.116249:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9bc909481000) 00010000:00010000:1.0:1788179158.116252:0:6606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788179158.116258:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49978b lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.116269:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c49978b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.116316:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179158.116318:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179158.116326:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179158.118025:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c49977d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.118048:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c49977d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.118056:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c49977d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.118082:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179158.118093:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c49977d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.118100:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c49977d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.118115:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bc909481e00) 00010000:00010000:3.0:1788179158.118122:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179158.118126:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c49977d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.118132:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c49977d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179158.175129:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179158.175291:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451069952 00000100:00100000:3.0:1788179158.175301:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451069952 00000100:00100000:3.0:1788179158.175412:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 200 00000100:00100000:3.0:1788179158.175431:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc901219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+36:11543:x1875041451069952:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:3.0:1788179158.175458:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179158.175489:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499792 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466228e expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.175631:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499799 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.175645:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499799 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.175672:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499799 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.175700:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4997a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.175708:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4997a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.175716:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4997a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788179158.176826:0:5796:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788179158.177070:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c4997a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.177084:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c4997a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.177093:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c4997a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.177133:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499799 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.177140:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499799 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.177147:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499799 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.177153:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179158.177165:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499799 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.177173:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499799 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.177185:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:3.0:1788179158.177188:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179158.177193:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499799 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.177200:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499799 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788179158.177212:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000272a5655 reply state 000000005cc1c17e transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4997a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179158.177222:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788179158.177373:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499792 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466228e expref: 39 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.177388:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c4997a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466228e expref: 38 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.177395:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54e00) 00010000:00010000:3.0:1788179158.177398:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788179158.177400:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4800, rc 0) 00000100:00100000:3.0:1788179158.178069:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc901219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+39:11543:x1875041451069952:12345-192.168.202.2@tcp:101:bash.0 Request processed in 2645us (2946us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788179158.178079:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 200 00010000:00010000:1.0:1788179158.184794:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4997a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.184811:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4997a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.184819:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4997a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.184824:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5e00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179158.184829:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4997a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.184836:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4997a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.185540:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bc902d54d00) 00010000:00010000:1.0:1788179158.185557:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179158.185563:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4997a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.185570:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c4997a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179158.185775:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179158.190940:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451070080 00000100:00100000:2.0:1788179158.190956:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451070080 00000100:00100000:2.0:1788179158.191726:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 59 00000100:00100000:2.0:1788179158.191739:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90121a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2357:x1875041451070080:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1788179158.191769:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179158.191789:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005c29ec3/0xaa4c98508c4997b5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662295 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788179158.191814:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788179158.191833:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=354s v=(0 0) 00010000:00010000:2.0:1788179158.191838:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179158.191878:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005c29ec3/0xaa4c98508c4997b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662295 expref: 6 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.191897:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000005c29ec3/0xaa4c98508c4997b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662295 expref: 6 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.191909:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c5600, rc 0) 00000100:00100000:2.0:1788179158.191968:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90121a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2357:x1875041451070080:12345-192.168.202.2@tcp:101:bash.0 Request processed in 233us (6197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179158.191976:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 59 00000100:00080000:0.0:1788179158.196581:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788179158.203181:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179158.203325:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451070208 00000100:00100000:3.0:1788179158.203335:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451070208 00000100:00100000:3.0:1788179158.203400:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00100000:3.0:1788179158.203411:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc901219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:11543:x1875041451070208:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:3.0:1788179158.203429:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179158.203447:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3a24993/0xaa4c98508c4997bc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466229c expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.203608:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000005c29ec3/0xaa4c98508c4997b5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662295 expref: 7 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.203619:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788179158.203623:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788179158.203629:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3a24993/0xaa4c98508c4997bc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466229c expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.203662:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000005c29ec3/0xaa4c98508c4997b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662295 expref: 7 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.203676:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000005c29ec3/0xaa4c98508c4997b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662295 expref: 7 pid: 6589 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179158.203701:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f6df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6590:1875041472033280:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788179158.203796:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc8013bf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788179158.207790:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179158.208239:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f6df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6590:1875041472033280:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788179158.208273:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a3a24993/0xaa4c98508c4997bc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466229c expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.208314:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4c00, rc 0) 00000100:00100000:3.0:1788179158.208377:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc901219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:11543:x1875041451070208:12345-192.168.202.2@tcp:101:bash.0 Request processed in 4967us (5203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179158.208387:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00100000:2.0:1788179158.209567:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788179158.209587:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f6df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472033408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788179158.209647:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179158.210042:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472033408 00000100:00100000:3.0:1788179158.210051:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472033408 00000100:00100000:3.0:1788179158.210102:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788179158.210113:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875041472033408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788179158.210148:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788179158.210248:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875041472033408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179158.210254:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788179158.210451:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451070336 00000100:00100000:0.0:1788179158.210456:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451070336 00010000:00010000:0.0:1788179158.210497:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000005c29ec3/0xaa4c98508c4997b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662295 expref: 7 pid: 6589 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179158.210532:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 77 00000100:00100000:0.0:1788179158.210539:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2357:x1875041451070336:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179158.210550:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179158.210570:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000005c29ec3/0xaa4c98508c4997b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662295 expref: 7 pid: 6589 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179158.210583:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000005c29ec3/0xaa4c98508c4997b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662295 expref: 7 pid: 6589 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179158.210628:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005c29ec3/0xaa4c98508c4997b5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662295 expref: 7 pid: 6589 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179158.210644:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788179158.210650:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788179158.210659:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3a24993/0xaa4c98508c4997bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466229c expref: 6 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179158.210669:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3a24993/0xaa4c98508c4997bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466229c expref: 6 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179158.210722:0:5783:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a3a24993/0xaa4c98508c4997bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466229c expref: 6 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179158.210734:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc901219c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5783:1875041472033536:192.168.202.2@tcp:105: 00000100:00100000:0.0:1788179158.210799:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc911185000 going to sleep for 11 seconds 00000100:00100000:0.0:1788179158.213701:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc901219c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5783:1875041472033536:192.168.202.2@tcp:105: 00010000:00010000:0.0:1788179158.213731:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179158.213786:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2357:x1875041451070336:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 3245us (6007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179158.213796:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 77 00000100:00100000:3.0:1788179158.214182:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179158.214445:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451070592 00000100:00100000:1.0:1788179158.214451:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451070592 00000100:00100000:1.0:1788179158.214504:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:1.0:1788179158.214513:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+38:11543:x1875041451070592:12345-192.168.202.2@tcp:35:bash.0 00000100:00100000:1.0:1788179158.214910:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+39:11543:x1875041451070592:12345-192.168.202.2@tcp:35:bash.0 Request processed in 397us (737us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788179158.214917:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 55 00000100:00100000:2.0:1788179158.219756:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f6df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472033408:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788179158.277142:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179158.405406:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179158.405498:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451070720 00000100:00100000:3.0:1788179158.405509:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451070720 00000100:00100000:3.0:1788179158.405572:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 201 00000100:00100000:3.0:1788179158.405582:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+39:11559:x1875041451070720:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1788179158.405615:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179158.405643:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4997c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746622a3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.405724:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4997ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.405738:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4997ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.405766:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4997ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179158.405836:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1788179158.405841:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788179158.405892:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4997ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.405916:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c4997c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622a3 expref: 41 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.405936:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4997ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622a3 expref: 40 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.405944:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:3.0:1788179158.405947:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788179158.405950:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4600, rc 0) 00000100:00100000:3.0:1788179158.406012:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+40:11559:x1875041451070720:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 431us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179158.406019:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 201 00000100:00100000:0.0:1788179158.415947:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179158.416041:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451070976 00000100:00100000:2.0:1788179158.416051:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451070976 00000100:00100000:2.0:1788179158.416112:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 202 00000100:00100000:2.0:1788179158.416123:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc901219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+40:11559:x1875041451070976:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788179158.416165:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179158.416185:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c4997d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746622aa expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.416284:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c4997d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.416296:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c4997d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.416308:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c4997d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179158.416318:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788179158.416433:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c4997d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622aa expref: 43 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.416452:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c4997d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622aa expref: 42 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.416461:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54e00) 00010000:00010000:2.0:1788179158.416464:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788179158.416467:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c5600, rc 0) 00000100:00100000:2.0:1788179158.416531:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc901219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+42:11559:x1875041451070976:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 409us (592us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788179158.416538:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 202 00000100:00100000:1.0:1788179158.428523:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179158.428610:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451071232 00000100:00100000:3.0:1788179158.428627:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451071232 00000100:00100000:3.0:1788179158.429228:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 203 00000100:00100000:0.0:1788179158.430058:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179158.430136:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451071360 00000100:00100000:1.0:1788179158.430143:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451071360 00000100:00100000:1.0:1788179158.430194:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:1.0:1788179158.430203:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90121b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+43:2357:x1875041451071360:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788179158.430218:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788179158.430243:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5600/0xaa4c98508c4997d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622aa expref: 43 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.430262:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54e00) 00010000:00010000:1.0:1788179158.430267:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788179158.430337:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90121b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+42:2357:x1875041451071360:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 136us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179158.430345:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:2.0:1788179158.435741:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+41:11559:x1875041451071232:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788179158.435778:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179158.435815:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c4997e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746622b1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.436026:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c4997ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.436040:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c4997ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.436052:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c4997ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179158.436064:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788179158.436182:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c4997e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622b1 expref: 44 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.436200:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c4997ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622b1 expref: 43 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.436208:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54e00) 00010000:00010000:2.0:1788179158.436211:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788179158.436214:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c5200, rc 0) 00000100:00100000:2.0:1788179158.436319:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+43:11559:x1875041451071232:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 7080us (7803us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788179158.436328:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 203 00000100:00100000:0.0:1788179158.450068:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179158.450230:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451071488 00000100:00100000:2.0:1788179158.450240:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451071488 00000100:00100000:2.0:1788179158.450295:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:2.0:1788179158.450306:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+6:2357:x1875041451071488:12345-192.168.202.2@tcp:1:lfs.0 00010000:00010000:2.0:1788179158.450358:0:6589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000175b3e1/0xaa4c98508c4997fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.450380:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3a24993/0xaa4c98508c4997bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466229c expref: 6 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.450389:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179158.450394:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788179158.450398:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000175b3e1/0xaa4c98508c4997fb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.450433:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a3a24993/0xaa4c98508c4997bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466229c expref: 6 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.450447:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a3a24993/0xaa4c98508c4997bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466229c expref: 6 pid: 6590 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179158.450461:0:6589:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b612d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6589:1875041472033664:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788179158.450543:0:6589:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e8e8480 going to sleep for 11 seconds 00000100:00100000:2.0:1788179158.452911:0:6589:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b612d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6589:1875041472033664:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788179158.452941:0:6589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000175b3e1/0xaa4c98508c4997fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179158.454071:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179158.454375:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451071616 00000100:00100000:1.0:1788179158.454383:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451071616 00002000:00100000:1.0:1788179158.454424:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9bc93f879880 x1875041451071616/t0(0) o4->334bb25c-6762-4beb-8a84-3a838cbc7e80@192.168.202.2@tcp:174/0 lens 504/0 e 0 to 0 dl 1788179169 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788179158.454436:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bc93f879880 with x1875041451071616 ext(0->8) 00010000:00010000:1.0:1788179158.454443:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a3a24993/0xaa4c98508c4997bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466229c expref: 7 pid: 6590 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.454458:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a3a24993/0xaa4c98508c4997bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466229c expref: 7 pid: 6590 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788179158.454466:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bc93f879880 00000100:00100000:1.0:1788179158.454495:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:1.0:1788179158.454504:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2356:x1875041451071616:12345-192.168.202.2@tcp:4:lfs.0 00000100:00100000:1.0:1788179158.455099:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+9:2356:x1875041451071616:12345-192.168.202.2@tcp:4:lfs.0 Request processed in 594us (1030us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788179158.455108:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 3 00002000:00100000:1.0:1788179158.455114:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9bc93f879880 x1875041451071616/t4294967308(0) o4->334bb25c-6762-4beb-8a84-3a838cbc7e80@192.168.202.2@tcp:174/0 lens 504/448 e 0 to 0 dl 1788179169 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788179158.455123:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bc93f879880 with x1875041451071616 ext(0->8) 00010000:00010000:1.0:1788179158.455129:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a3a24993/0xaa4c98508c4997bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466229c expref: 9 pid: 6590 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.455152:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a3a24993/0xaa4c98508c4997bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466229c expref: 9 pid: 6590 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788179158.455159:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9bc93f879880 00000100:00100000:1.0:1788179158.461846:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179158.462950:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451071744 00000100:00100000:2.0:1788179158.462960:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451071744 00010000:00010000:2.0:1788179158.463001:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a3a24993/0xaa4c98508c4997bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466229c expref: 9 pid: 6590 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179158.463059:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 78 00000100:00100000:2.0:1788179158.463069:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+9:2357:x1875041451071744:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788179158.463087:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788179158.463105:0:5781:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788179158.463108:0:5781:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788179157 00002000:00010000:2.0:1788179158.463110:0:5781:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788179157 00002000:00010000:2.0:1788179158.463112:0:5781:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788179157 00010000:00010000:2.0:1788179158.463118:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a3a24993/0xaa4c98508c4997bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466229c expref: 9 pid: 6590 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.463132:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a3a24993/0xaa4c98508c4997bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466229c expref: 9 pid: 6590 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.463153:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3a24993/0xaa4c98508c4997bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466229c expref: 9 pid: 6590 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.463170:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788179158.463174:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788179158.463180:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000175b3e1/0xaa4c98508c4997fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.463190:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000175b3e1/0xaa4c98508c4997fb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.463278:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788179158.463343:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2357:x1875041451071744:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 274us (1504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179158.463350:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 78 00010000:00010000:3.0:1788179158.465329:0:6589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000175b3e1/0xaa4c98508c4997fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.465344:0:6589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000175b3e1/0xaa4c98508c4997fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.465390:0:6589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000175b3e1/0xaa4c98508c4997fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.465397:0:6589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000175b3e1/0xaa4c98508c4997fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.465405:0:6589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000175b3e1/0xaa4c98508c4997fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.465412:0:6589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c4000 already unused, calling callback (ffffffffc1644220) 00010000:00010000:3.0:1788179158.465416:0:6589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000175b3e1/0xaa4c98508c4997fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.465425:0:6589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000175b3e1/0xaa4c98508c4997fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.465441:0:6589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000175b3e1/0xaa4c98508c4997fb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.465448:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000175b3e1/0xaa4c98508c4997fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179158.465522:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2357:x1875041451071488:12345-192.168.202.2@tcp:1:lfs.0 Request processed in 15216us (15462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179158.465531:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:1.0:1788179158.475196:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179158.475282:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451072000 00000100:00100000:0.0:1788179158.475292:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451072000 00000100:00100000:0.0:1788179158.475349:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 56 00000100:00100000:0.0:1788179158.475360:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9071ec050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+43:11559:x1875041451072000:12345-192.168.202.2@tcp:35:lfs.0 00000004:00010000:0.0:1788179158.475421:0:5800:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c4997ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622b1 expref: 43 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788179158.475668:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1788179158.475975:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1788179158.476259:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1788179158.476312:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499802 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179158.476327:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c4997a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466228e expref: 47 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179158.476337:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499802 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179158.476370:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c4997a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466228e expref: 47 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179158.476384:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c4997a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466228e expref: 47 pid: 5796 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179158.476399:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f878380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5800:1875041472033792:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788179158.476571:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93fadc180 going to sleep for 11 seconds 00000100:00100000:0.0:1788179158.479646:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179158.479759:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451072128 00000100:00100000:2.0:1788179158.479768:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451072128 00010000:00010000:2.0:1788179158.479807:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c4997a7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466228e expref: 48 pid: 5796 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179158.479897:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 79 00000100:00100000:2.0:1788179158.479907:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+48:2357:x1875041451072128:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788179158.479919:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179158.479926:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c4997a7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466228e expref: 48 pid: 5796 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.479937:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c4997a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466228e expref: 48 pid: 5796 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.479958:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54e00) 00010000:00010000:2.0:1788179158.479963:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499802 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.479973:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499802 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.479980:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499802 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.479996:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788179158.480053:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+48:2357:x1875041451072128:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 147us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179158.480067:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 79 00010000:00010000:1.0:1788179158.481368:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c4997a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466228e expref: 47 pid: 5796 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179158.481388:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f878380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5800:1875041472033792:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788179158.481408:0:5800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499802 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179158.481491:0:5800:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499802 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179158.481499:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499802 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788179158.482833:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788179158.483090:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1788179158.483194:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5800:1875041472033920:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788179158.483354:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179158.483468:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc91865c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788179158.484170:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472033920 00000100:00100000:2.0:1788179158.484178:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472033920 00000100:00100000:2.0:1788179158.484661:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788179158.484671:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5800:x1875041472033920:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788179158.484819:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5800:x1875041472033920:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 149us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179158.484846:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788179158.485994:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5800:1875041472033920:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788179158.486779:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1788179158.486880:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc910b9ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5800:1875041472034048:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788179158.486945:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179158.487048:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93fadc900 going to sleep for 11 seconds 00000100:00100000:2.0:1788179158.487083:0:12320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472034048 00000100:00100000:2.0:1788179158.487089:0:12320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472034048 00000100:00100000:2.0:1788179158.487149:0:12320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788179158.487157:0:12320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5800:x1875041472034048:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788179158.487472:0:12320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5800:x1875041472034048:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 315us (525us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788179158.487481:0:12320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788179158.487534:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc910b9ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5800:1875041472034048:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788179158.487649:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1788179158.487744:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499802 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179158.487756:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499802 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179158.487764:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499802 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179158.487770:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317fa00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179158.487774:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499802 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179158.487799:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499802 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179158.487831:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54e00) 00010000:00010000:0.0:1788179158.487835:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788179158.487839:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499802 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179158.487845:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499802 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788179158.488026:0:5800:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788179158.488122:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1788179158.488133:0:5800:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 354551283082ns, next at 355551280495ns, rc = 0 00000001:00080000:0.0:1788179158.488139:0:5800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1788179158.488170:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54e00) 00010000:00010000:0.0:1788179158.488173:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788179158.488180:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c4997ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622b1 expref: 51 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179158.488450:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9071ec050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+50:11559:x1875041451072000:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 13077us (13247us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1788179158.488460:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 56 00000020:00080000:0.0:1788179158.488464:0:5800:0:(tgt_main.c:811:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788179158.491971:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179158.492175:0:12275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451072256 00000100:00100000:3.0:1788179158.492185:0:12275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451072256 00000100:00100000:3.0:1788179158.492243:0:12275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 204 00000100:00100000:3.0:1788179158.492254:0:12275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+50:11559:x1875041451072256:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1788179158.492279:0:12275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179158.492303:0:12275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499809 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746622b8 expref: -99 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.492358:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499809 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622b8 expref: 51 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.492373:0:12275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499809 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622b8 expref: 51 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.492390:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:3.0:1788179158.492394:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788179158.492397:0:12275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b5200, rc 0) 00000100:00100000:3.0:1788179158.492492:0:12275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+51:11559:x1875041451072256:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 239us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179158.492500:0:12275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 204 00000100:00100000:2.0:1788179158.496326:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179158.496471:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451072512 00000100:00100000:3.0:1788179158.496481:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451072512 00000100:00100000:3.0:1788179158.496565:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00100000:3.0:1788179158.496574:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+51:11559:x1875041451072512:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:3.0:1788179158.497207:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+52:11559:x1875041451072512:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 632us (887us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1788179158.497216:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 57 00000100:00100000:1.0:1788179158.601184:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179158.601305:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451072640 00000100:00100000:3.0:1788179158.601316:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451072640 00000100:00100000:3.0:1788179158.601378:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 205 00000100:00100000:3.0:1788179158.601389:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+52:11569:x1875041451072640:12345-192.168.202.2@tcp:34:lfs.0 00010000:00010000:3.0:1788179158.601467:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499810 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601483:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499810 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601494:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499810 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601509:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499817 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601515:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601521:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601613:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49981e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601621:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49981e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601628:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49981e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788179158.601666:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49981e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601714:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499810 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601721:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499810 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601727:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499810 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601733:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5600 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179158.601737:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499810 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601744:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499810 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601755:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:3.0:1788179158.601758:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179158.601762:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499810 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601767:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499810 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601780:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601786:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499817 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601791:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499817 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601801:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4800 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179158.601805:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499817 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601810:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499817 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601817:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bc902d54500) 00010000:00010000:3.0:1788179158.601819:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179158.601821:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499817 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601827:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499817 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601840:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49981e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601846:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49981e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601910:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49981e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601915:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4c00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179158.601918:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49981e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601923:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49981e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601943:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:3.0:1788179158.601945:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179158.601948:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49981e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.601953:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49981e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179158.602031:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+52:11569:x1875041451072640:12345-192.168.202.2@tcp:34:lfs.0 Request processed in 642us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179158.602039:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 205 00000100:00100000:0.0:1788179158.658708:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179158.659025:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451072896 00000100:00100000:2.0:1788179158.659036:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451072896 00000100:00100000:2.0:1788179158.659095:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 206 00000100:00100000:2.0:1788179158.659106:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc901218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+52:11572:x1875041451072896:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788179158.659127:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179158.659147:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499825 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746622bf expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.659232:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c49982c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.659267:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c49982c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.659279:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c49982c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.659295:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499833 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.659302:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.659309:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.659438:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49983a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.659447:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49983a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.659454:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49983a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179158.659462:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788179158.659552:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c49982c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.659560:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c49982c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.659566:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c49982c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.659578:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179158.659583:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c49982c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.659603:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c49982c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.659615:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:2.0:1788179158.659618:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179158.659623:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c49982c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.659629:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c49982c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.659643:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.659649:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499833 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.659655:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499833 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.659661:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179158.659663:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499833 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.659669:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499833 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.659699:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bc909481d00) 00010000:00010000:2.0:1788179158.659702:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179158.659705:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499833 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.659710:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499833 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.659760:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499825 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622bf expref: 55 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.659774:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49983a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622bf expref: 54 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.659781:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:2.0:1788179158.659783:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788179158.659785:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c5800, rc 0) 00000100:00100000:2.0:1788179158.659913:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc901218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+54:11572:x1875041451072896:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 808us (1228us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788179158.659920:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 206 00000100:00100000:2.0:1788179158.670338:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179158.670476:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451073024 00000100:00100000:3.0:1788179158.670486:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451073024 00000100:00100000:3.0:1788179158.670546:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 207 00000100:00100000:3.0:1788179158.670557:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+54:11572:x1875041451073024:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:3.0:1788179158.670635:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499848 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.670652:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.670664:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.670698:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.670706:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499848 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.670731:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499848 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.670737:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4c00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179158.670741:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499848 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.670749:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499848 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.670760:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:3.0:1788179158.670763:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788179158.670768:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499848 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.670774:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499848 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179158.670905:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+54:11572:x1875041451073024:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 293us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179158.670914:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 207 00000100:00100000:0.0:1788179158.680587:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179158.680889:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451073280 00000100:00100000:2.0:1788179158.680899:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451073280 00000100:00100000:2.0:1788179158.680952:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 58 00000100:00100000:2.0:1788179158.680963:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+54:11572:x1875041451073280:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:2.0:1788179158.684024:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+55:11572:x1875041451073280:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 3051us (3433us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788179158.684053:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 58 00000001:00080000:3.0:1788179158.785798:0:7496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1788179158.785823:0:7496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:2.0:1788179158.833629:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179158.835742:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451073536 00000100:00100000:3.0:1788179158.835759:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451073536 00000100:00100000:3.0:1788179158.835838:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 208 00000100:00100000:3.0:1788179158.835886:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+55:11582:x1875041451073536:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:3.0:1788179158.835913:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179158.835917:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788179158.835964:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4600/0xaa4c98508c4997ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622a3 expref: 55 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.835987:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:3.0:1788179158.835993:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788179158.836008:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49984f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746622c6 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.836130:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499856 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.836148:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.836159:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179158.836170:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788179158.836948:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49984f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622c6 expref: 57 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.836967:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499856 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622c6 expref: 56 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179158.836974:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:3.0:1788179158.836976:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788179158.836979:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4800, rc 0) 00000100:00100000:3.0:1788179158.837047:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+56:11582:x1875041451073536:12345-192.168.202.2@tcp:101:bash.0 Request processed in 1199us (3463us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788179158.837055:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 208 00000100:00100000:3.0:1788179158.841870:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179158.842044:0:12275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451073792 00000100:00100000:1.0:1788179158.842054:0:12275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451073792 00000100:00100000:1.0:1788179158.842104:0:12275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 209 00000100:00100000:1.0:1788179158.842114:0:12275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+56:11582:x1875041451073792:12345-192.168.202.2@tcp:36:bash.0 00010000:00010000:1.0:1788179158.842176:0:12275:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788179158.842201:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c499856 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622c6 expref: 56 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.842221:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c49983a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622bf expref: 55 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.842248:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:1.0:1788179158.842252:0:12275:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788179158.842883:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499864 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.842898:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499864 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.842907:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499864 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788179158.842963:0:12275:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1788179158.842990:0:12275:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005ee6de7d reply state 0000000016505769 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499864 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179158.842998:0:12275:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788179158.843089:0:12275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+57:11582:x1875041451073792:12345-192.168.202.2@tcp:36:bash.0 Request processed in 976us (1253us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1788179158.843097:0:12275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 209 00000020:00080000:1.0:1788179158.843102:0:12275:0:(tgt_main.c:811:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788179158.850126:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499864 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.850145:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499864 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.850151:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499864 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.850157:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc942173e00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179158.850176:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499864 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.850184:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499864 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.850199:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:1.0:1788179158.850202:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179158.850207:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499864 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.850214:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499864 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179158.854051:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179158.854181:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451073920 00000100:00100000:2.0:1788179158.854194:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451073920 00000100:00100000:2.0:1788179158.854263:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 210 00000100:00100000:2.0:1788179158.854275:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+56:11582:x1875041451073920:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1788179158.854306:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179158.854342:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c49986b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746622cd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.854482:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499872 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.854497:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.854508:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179158.854557:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788179158.854563:0:5827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788179158.854592:0:5827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.854970:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c49986b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622cd expref: 58 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.854987:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499872 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622cd expref: 57 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.855008:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:2.0:1788179158.855011:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788179158.855015:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c5200, rc 0) 00000100:00100000:1.0:1788179158.855786:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+57:11582:x1875041451073920:12345-192.168.202.2@tcp:101:bash.0 Request processed in 1510us (1739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179158.855796:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 210 00000100:00100000:3.0:1788179158.866960:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179158.867053:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451074176 00000100:00100000:1.0:1788179158.867061:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451074176 00000100:00100000:1.0:1788179158.867148:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 59 00000100:00100000:1.0:1788179158.867225:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+57:11582:x1875041451074176:12345-192.168.202.2@tcp:35:bash.0 00000100:00100000:1.0:1788179158.867447:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+58:11582:x1875041451074176:12345-192.168.202.2@tcp:35:bash.0 Request processed in 292us (496us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1788179158.867453:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 59 00000100:00100000:1.0:1788179158.953805:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179158.953895:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451074304 00000100:00100000:2.0:1788179158.953906:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451074304 00000100:00100000:2.0:1788179158.953977:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 211 00000100:00100000:2.0:1788179158.953989:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+58:11588:x1875041451074304:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788179158.954016:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179158.954040:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499879 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746622d4 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.954114:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499880 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.954132:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.954148:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179158.954228:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1788179158.954233:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788179158.954256:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.954281:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c499879 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622d4 expref: 60 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.954348:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499880 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622d4 expref: 59 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.954359:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:2.0:1788179158.954362:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788179158.954366:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c5000, rc 0) 00000100:00100000:2.0:1788179158.954443:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+59:11588:x1875041451074304:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 455us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179158.954450:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 211 00000100:00100000:3.0:1788179158.956787:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179158.957177:0:12275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451074432 00000100:00100000:1.0:1788179158.957187:0:12275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451074432 00000100:00100000:1.0:1788179158.957249:0:12275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 212 00000100:00100000:1.0:1788179158.957260:0:12275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+59:11588:x1875041451074432:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:1.0:1788179158.957292:0:12275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179158.957320:0:12275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499887 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746622db expref: -99 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.957699:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c49988e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.957714:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c49988e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.957725:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c49988e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.957739:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c499895 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.957747:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c499895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.957753:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c499895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.957872:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c49989c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.957881:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c49989c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.957888:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c49989c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788179158.957934:0:12275:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788179158.957943:0:12275:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788179158.957966:0:12275:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c49989c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.957978:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c49989c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.957987:0:12275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c49988e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.957993:0:12275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c49988e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.958000:0:12275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c49988e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.958007:0:12275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc942172400 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179158.958011:0:12275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c49988e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.958019:0:12275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c49988e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.958031:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:1.0:1788179158.958035:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179158.958040:0:12275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c49988e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.958047:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172400/0xaa4c98508c49988e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.958060:0:12275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c499895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.958079:0:12275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c499895 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.958085:0:12275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c499895 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.958091:0:12275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92e12dc00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179158.958094:0:12275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c499895 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.958100:0:12275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c499895 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.958108:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bc903340e00) 00010000:00010000:1.0:1788179158.958110:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179158.958112:0:12275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c499895 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.958118:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12dc00/0xaa4c98508c499895 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.958152:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173e00/0xaa4c98508c499887 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622db expref: 61 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.958165:0:12275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c49989c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622db expref: 60 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.958173:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:1.0:1788179158.958175:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788179158.958183:0:12275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc92e12c200, rc 0) 00000100:00100000:1.0:1788179158.958255:0:12275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+60:11588:x1875041451074432:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 997us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179158.958263:0:12275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 212 00000100:00100000:3.0:1788179158.961258:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179158.961582:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451074560 00000100:00100000:2.0:1788179158.961594:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451074560 00000100:00100000:2.0:1788179158.961662:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:2.0:1788179158.961674:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+60:2356:x1875041451074560:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788179158.961703:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179158.961728:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c200/0xaa4c98508c49989c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622db expref: 60 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.961747:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:2.0:1788179158.961752:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788179158.961803:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+59:2356:x1875041451074560:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 131us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179158.961810:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:3.0:1788179158.966722:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179158.967120:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451074816 00000100:00100000:0.0:1788179158.967149:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451074816 00000100:00100000:0.0:1788179158.967203:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 213 00000100:00100000:0.0:1788179158.967213:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+59:11588:x1875041451074816:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788179158.967234:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179158.967255:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c4998a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746622e2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179158.967516:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4998aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179158.967690:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499872 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622cd expref: 60 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179158.967702:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4998aa lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179158.967841:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499872 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746622cd expref: 60 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179158.967874:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499872 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746622cd expref: 60 pid: 5827 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179158.967889:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a21180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5827:1875041472034176:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788179158.968021:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9354266c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788179158.973950:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179158.974189:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a21180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5827:1875041472034176:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788179158.974217:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4998aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179158.977008:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451074944 00000100:00100000:2.0:1788179158.977024:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451074944 00010000:00010000:2.0:1788179158.977079:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499872 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746622cd expref: 61 pid: 5827 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179158.977128:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 80 00000100:00100000:2.0:1788179158.977138:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f82d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+61:2356:x1875041451074944:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788179158.977152:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179158.977159:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499872 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746622cd expref: 61 pid: 5827 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.977173:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499872 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746622cd expref: 61 pid: 5827 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.977200:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c499872 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746622cd expref: 61 pid: 5827 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.977220:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:2.0:1788179158.977227:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4998aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.977237:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4998aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.977246:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4998aa lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179158.977846:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788179158.977942:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f82d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+60:2356:x1875041451074944:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 803us (4002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179158.977951:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 80 00010000:00010000:0.0:1788179158.979185:0:5827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4998aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179158.979459:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4998aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179158.979494:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788179158.980785:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c4998a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622e2 expref: 61 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179158.980823:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4998aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622e2 expref: 60 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179158.980833:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:0.0:1788179158.980836:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788179158.980839:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317f000, rc 0) 00000100:00100000:0.0:1788179158.981611:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+60:11588:x1875041451074816:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 14395us (14894us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788179158.981629:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 213 00000100:00100000:3.0:1788179158.985013:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179158.985499:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451075200 00000100:00100000:0.0:1788179158.985518:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451075200 00000100:00100000:0.0:1788179158.986743:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:0.0:1788179158.986756:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90710d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+60:11588:x1875041451075200:12345-192.168.202.2@tcp:103:lfs.0 00010000:00010000:0.0:1788179158.986791:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179158.986830:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499809 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622b8 expref: 60 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179158.986897:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:0.0:1788179158.986903:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179158.987056:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90710d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+59:11588:x1875041451075200:12345-192.168.202.2@tcp:103:lfs.0 Request processed in 302us (2060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179158.987086:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:3.0:1788179158.997052:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179158.997153:0:12275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451075328 00000100:00100000:1.0:1788179158.997163:0:12275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451075328 00000100:00100000:1.0:1788179158.997223:0:12275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 214 00000100:00100000:1.0:1788179158.997232:0:12275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f82df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+59:11588:x1875041451075328:12345-192.168.202.2@tcp:58:lfs.0 00010000:00010000:1.0:1788179158.997328:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c4998b8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.997344:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c4998b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179158.997355:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c4998b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788179158.997526:0:12275:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788179158.997622:0:12275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f82df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+59:11588:x1875041451075328:12345-192.168.202.2@tcp:58:lfs.0 Request processed in 390us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179158.997629:0:12275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 214 00000100:00100000:1.0:1788179159.002181:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179159.002283:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451075456 00000100:00100000:0.0:1788179159.002293:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451075456 00000100:00100000:0.0:1788179159.002585:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 215 00000100:00100000:0.0:1788179159.002613:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+59:11588:x1875041451075456:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788179159.002634:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179159.002656:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c4998bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746622e9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.002729:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c4998b8 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.002740:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c4998bf lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622e9 expref: 60 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.002759:0:5798:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c4998b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.002772:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c4998bf lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622e9 expref: 60 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.002784:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:0.0:1788179159.002787:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788179159.002791:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c4998bf lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622e9 expref: 60 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.002799:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317f400, rc 0) 00000100:00100000:0.0:1788179159.002897:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+60:11588:x1875041451075456:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 287us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179159.002904:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 215 00000100:00080000:2.0:1788179159.011615:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788179159.040120:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788179159.040131:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788179159.040170:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1788179159.040179:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788179159.040314:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358f9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1875041472034304:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788179159.040576:0:11535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc902ea60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788179159.048374:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358f9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1875041472034304:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788179159.052989:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179159.053450:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451075584 00000100:00100000:0.0:1788179159.053460:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451075584 00000100:00100000:0.0:1788179159.053522:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 216 00000100:00100000:0.0:1788179159.053596:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f82d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+60:11589:x1875041451075584:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788179159.053744:0:5827:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788179159.053999:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f82d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+60:11589:x1875041451075584:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 467us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179159.054007:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 216 00000100:00100000:1.0:1788179159.057901:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179159.058478:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451075712 00000100:00100000:2.0:1788179159.058489:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451075712 00000100:00100000:2.0:1788179159.058563:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 217 00000100:00100000:2.0:1788179159.058574:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9358f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+60:11589:x1875041451075712:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788179159.058646:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c4998c6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.058663:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c4998c6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.058675:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c4998c6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.058736:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c4998cd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.058744:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c4998cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.058752:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c4998cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.058775:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c4998d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.058783:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c4998d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.058788:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c4998d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179159.058840:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788179159.058884:0:5797:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788179159.058898:0:5797:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c4998d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.058910:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c4998c6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.058916:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c4998c6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.058924:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c4998c6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.058929:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179159.058933:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c4998c6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.058941:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c4998c6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.058952:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bc903340c00) 00010000:00010000:2.0:1788179159.058955:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179159.058961:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c4998c6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.058966:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5200/0xaa4c98508c4998c6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.058978:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c4998cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.058983:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c4998cd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.058998:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c4998cd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.059004:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c4600 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179159.059007:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c4998cd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.059013:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c4998cd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.059021:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9bc909481e00) 00010000:00010000:2.0:1788179159.059023:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179159.059026:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c4998cd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.059032:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4600/0xaa4c98508c4998cd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.059055:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c4998d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.059062:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c4998d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.059068:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c4998d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.059073:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c4a00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179159.059076:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c4998d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.059090:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c4998d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.059098:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:2.0:1788179159.059101:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179159.059104:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c4998d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.059109:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c4998d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179159.059185:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9358f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+60:11589:x1875041451075712:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 Request processed in 612us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179159.059193:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 217 00000100:00100000:1.0:1788179159.061961:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179159.062700:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451075968 00000100:00100000:2.0:1788179159.062709:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451075968 00000100:00100000:2.0:1788179159.062756:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 218 00000100:00100000:2.0:1788179159.062766:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f878380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+60:11589:x1875041451075968:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788179159.062786:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179159.062804:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c4998db lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746622f0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.062908:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c4998e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.062922:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c4998e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.062933:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c4998e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179159.062968:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788179159.063063:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c4998e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.063071:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c4998e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.063077:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c4998e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.063082:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5e00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179159.063086:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c4998e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.063093:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c4998e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.063105:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:2.0:1788179159.063107:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788179159.063112:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c4998e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.063118:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c4998e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.063155:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c4998db lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622f0 expref: 62 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.063165:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bc903340c00) 00010000:00010000:2.0:1788179159.063167:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788179159.063180:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c4998db lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622f0 expref: 62 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.063193:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c4000, rc 0) 00000100:00100000:2.0:1788179159.063252:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f878380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+61:11589:x1875041451075968:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 487us (1298us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1788179159.063260:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 218 00000100:00100000:0.0:1788179159.072492:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179159.072584:0:12275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451076096 00000100:00100000:1.0:1788179159.072594:0:12275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451076096 00000100:00100000:1.0:1788179159.072664:0:12275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 219 00000100:00100000:1.0:1788179159.072674:0:12275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+61:11589:x1875041451076096:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788179159.072720:0:12275:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788179159.072829:0:12275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+61:11589:x1875041451076096:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 155us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179159.072836:0:12275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 219 00000100:00100000:1.0:1788179159.075631:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179159.075792:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451076352 00000100:00100000:0.0:1788179159.075802:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451076352 00000100:00100000:0.0:1788179159.076034:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 220 00000100:00100000:0.0:1788179159.076044:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+61:11589:x1875041451076352:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788179159.076063:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179159.076065:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788179159.076099:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499880 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622d4 expref: 61 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.076116:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:0.0:1788179159.076122:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788179159.076134:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4998f0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746622f7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788179159.076549:0:5798:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1788179159.076959:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4998f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.076971:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4998f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.076978:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4998f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.077029:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c4998f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622f7 expref: 63 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.077046:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4998f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622f7 expref: 62 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.077054:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bc9062cb900) 00010000:00010000:0.0:1788179159.077057:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788179159.077059:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317ee00, rc 0) 00000100:00100000:0.0:1788179159.077138:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+62:11589:x1875041451076352:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 1095us (1515us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788179159.077146:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 220 00000100:00100000:0.0:1788179159.081790:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179159.081945:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451076608 00000100:00100000:1.0:1788179159.081956:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451076608 00000100:00100000:1.0:1788179159.082014:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 221 00000100:00100000:1.0:1788179159.082025:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+62:11589:x1875041451076608:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788179159.082081:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788179159.082105:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4998f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622f7 expref: 62 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.082124:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bc9062cb900) 00010000:00010000:1.0:1788179159.082134:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788179159.082156:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c499905 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.082168:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c499905 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.082178:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c499905 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.082207:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c49990c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xdb9fa066 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.082215:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c49990c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdb9fa066 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.082221:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c49990c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdb9fa066 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.082291:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c499905 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.082297:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c499905 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.082303:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c499905 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.082308:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92e12de00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179159.082311:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c499905 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.082318:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c499905 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.082325:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:1.0:1788179159.082327:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179159.082330:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c499905 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.082335:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12de00/0xaa4c98508c499905 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.082348:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c49990c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdb9fa066 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.082355:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c49990c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdb9fa066 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.082359:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c49990c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdb9fa066 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.082364:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92e12c400 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179159.082366:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c49990c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdb9fa066 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.082372:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c49990c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdb9fa066 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.082378:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xdb9fa066 (ffff9bc903340e00) 00010000:00010000:1.0:1788179159.082380:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179159.082382:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c49990c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xdb9fa066 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.082387:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12c400/0xaa4c98508c49990c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xdb9fa066 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179159.082472:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+61:11589:x1875041451076608:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 449us (692us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788179159.082479:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 221 00000100:00100000:3.0:1788179159.086383:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179159.086495:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451076736 00000100:00100000:2.0:1788179159.086505:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451076736 00000100:00100000:2.0:1788179159.086564:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 222 00000100:00100000:2.0:1788179159.086574:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+61:11589:x1875041451076736:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788179159.086593:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179159.086615:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c499913 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746622fe expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.086651:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49991a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.086664:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49991a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.086675:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49991a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.087216:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5e00/0xaa4c98508c499913 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622fe expref: 63 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.087235:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49991a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622fe expref: 62 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.087257:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bc909481e00) 00010000:00010000:2.0:1788179159.087261:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788179159.087265:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c4a00, rc 0) 00000100:00100000:2.0:1788179159.087378:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+62:11589:x1875041451076736:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 805us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179159.087386:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 222 00000100:00100000:2.0:1788179159.092278:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179159.092371:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451076992 00000100:00100000:0.0:1788179159.092381:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451076992 00000100:00100000:0.0:1788179159.092467:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 223 00000100:00100000:0.0:1788179159.092478:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+62:11589:x1875041451076992:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788179159.092583:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499921 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.092609:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499921 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.092620:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499921 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788179159.093093:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:0.0:1788179159.093178:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006b5c08fe reply state 000000009967a59c transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499921 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179159.093188:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788179159.093319:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+64:11589:x1875041451076992:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 842us (1050us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1788179159.093327:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 223 00010000:00010000:1.0:1788179159.096332:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499921 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.096361:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499921 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.096366:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499921 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.096370:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317e200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179159.096374:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499921 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.096379:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499921 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.096393:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bc909481e00) 00010000:00010000:1.0:1788179159.096395:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788179159.096398:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499921 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.096402:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499921 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179159.097773:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179159.098054:0:12275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451077120 00000100:00100000:3.0:1788179159.098063:0:12275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451077120 00000100:00100000:3.0:1788179159.098109:0:12275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 224 00000100:00100000:3.0:1788179159.098116:0:12275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+63:11589:x1875041451077120:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788179159.098136:0:12275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179159.098158:0:12275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499928 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662305 expref: -99 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.098201:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499928 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662305 expref: 64 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.098210:0:12275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499928 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662305 expref: 64 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.098222:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bc909481e00) 00010000:00010000:3.0:1788179159.098224:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788179159.098226:0:12275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4c00, rc 0) 00000100:00100000:3.0:1788179159.098280:0:12275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+64:11589:x1875041451077120:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 164us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179159.098287:0:12275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 224 00000100:00100000:3.0:1788179159.101115:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179159.101297:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451077248 00000100:00100000:1.0:1788179159.101306:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451077248 00000100:00100000:1.0:1788179159.101369:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 62 00000100:00100000:1.0:1788179159.101378:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+9:2357:x1875041451077248:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788179159.101674:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+10:2357:x1875041451077248:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 297us (567us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788179159.101692:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 62 00000100:00080000:2.0:1788179159.101829:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788179159.107947:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179159.108696:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451077504 00000100:00100000:1.0:1788179159.108818:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451077504 00000100:00100000:1.0:1788179159.108885:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00100000:1.0:1788179159.108895:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+64:11589:x1875041451077504:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788179159.109274:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+65:11589:x1875041451077504:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 379us (1334us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1788179159.109282:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 60 00000100:00100000:0.0:1788179159.114195:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179159.115911:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451077760 00000100:00100000:2.0:1788179159.115923:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451077760 00000100:00100000:2.0:1788179159.118427:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 225 00000100:00100000:2.0:1788179159.118535:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+65:11589:x1875041451077760:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788179159.118885:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+65:11589:x1875041451077760:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 362us (4749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179159.118895:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 225 00000100:00100000:3.0:1788179159.124769:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179159.124891:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451077888 00000100:00100000:0.0:1788179159.124901:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451077888 00000100:00100000:0.0:1788179159.124973:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 226 00000100:00100000:0.0:1788179159.124984:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+65:11589:x1875041451077888:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788179159.125007:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179159.125032:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c49992f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466230c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.125124:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499936 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.125168:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.125183:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179159.125231:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788179159.125254:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.125288:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c49992f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466230c expref: 67 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.125311:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499936 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466230c expref: 66 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.125323:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bc909481e00) 00010000:00010000:0.0:1788179159.125327:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788179159.125331:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317e200, rc 0) 00000100:00100000:0.0:1788179159.125416:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+66:11589:x1875041451077888:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 434us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179159.125424:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 226 00000100:00100000:0.0:1788179159.128102:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179159.129949:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451078016 00000100:00100000:3.0:1788179159.129962:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451078016 00000100:00100000:3.0:1788179159.130042:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00100000:3.0:1788179159.130053:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a4a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+10:2357:x1875041451078016:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788179159.130072:0:6591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179159.130092:0:6591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006daf256f/0xaa4c98508c49993d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662313 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788179159.130119:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9572d6, blocks: 0x1 00010000:00010000:3.0:1788179159.130136:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788179159.130141:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788179159.130151:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006daf256f/0xaa4c98508c49993d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662313 expref: 11 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.130171:0:6591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006daf256f/0xaa4c98508c49993d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662313 expref: 11 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.130185:0:6591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4600, rc 0) 00000100:00100000:3.0:1788179159.130258:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a4a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+11:2357:x1875041451078016:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 207us (2162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179159.130265:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00100000:2.0:1788179159.134290:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179159.134483:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451078272 00000100:00100000:1.0:1788179159.134493:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451078272 00000100:00100000:1.0:1788179159.134584:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 227 00000100:00100000:1.0:1788179159.134604:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+66:11589:x1875041451078272:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788179159.134722:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+66:11589:x1875041451078272:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 120us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179159.134730:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 227 00000100:00100000:0.0:1788179159.138917:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179159.138997:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451078400 00000100:00100000:1.0:1788179159.139006:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451078400 00000100:00100000:1.0:1788179159.139061:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 64 00000100:00100000:1.0:1788179159.139071:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+11:11589:x1875041451078400:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788179159.139089:0:7778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179159.139106:0:7778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea62733c/0xaa4c98508c499944 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466231a expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.139138:0:7778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006daf256f/0xaa4c98508c49993d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662313 expref: 12 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.139156:0:7778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179159.139160:0:7778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179159.139181:0:7778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea62733c/0xaa4c98508c499944 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466231a expref: 12 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.139215:0:7778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006daf256f/0xaa4c98508c49993d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662313 expref: 12 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.139229:0:7778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006daf256f/0xaa4c98508c49993d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662313 expref: 12 pid: 6591 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179159.139243:0:7778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9359bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7778:1875041472034432:192.168.202.2@tcp:104: 00000100:00100000:1.0:1788179159.139347:0:7778:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc902ea66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788179159.144003:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179159.144533:0:11517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451078528 00000100:00100000:2.0:1788179159.144542:0:11517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451078528 00010000:00010000:2.0:1788179159.144582:0:11517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006daf256f/0xaa4c98508c49993d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662313 expref: 13 pid: 6591 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179159.144640:0:11517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 81 00000100:00100000:2.0:1788179159.144651:0:11517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+13:2356:x1875041451078528:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788179159.144665:0:11517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179159.144717:0:11517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006daf256f/0xaa4c98508c49993d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662313 expref: 13 pid: 6591 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.144731:0:11517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006daf256f/0xaa4c98508c49993d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662313 expref: 13 pid: 6591 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.144757:0:11517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179159.144762:0:11517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179159.144771:0:11517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea62733c/0xaa4c98508c499944 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466231a expref: 13 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.144781:0:11517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea62733c/0xaa4c98508c499944 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466231a expref: 13 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.144823:0:11517:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ea62733c/0xaa4c98508c499944 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466231a expref: 13 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179159.144840:0:11517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b6a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11517:1875041472034560:192.168.202.2@tcp:105: 00000100:00100000:2.0:1788179159.144988:0:11517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc901377000 going to sleep for 11 seconds 00010000:00010000:1.0:1788179159.146123:0:7778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006daf256f/0xaa4c98508c49993d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662313 expref: 13 pid: 6591 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179159.146139:0:7778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9359bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7778:1875041472034432:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788179159.146176:0:7778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea62733c/0xaa4c98508c499944 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466231a expref: 12 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.146189:0:7778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc92e12c400, rc 0) 00000100:00100000:1.0:1788179159.146237:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+12:11589:x1875041451078400:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 7168us (7330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179159.146243:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 64 00000100:00100000:2.0:1788179159.148283:0:11517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b6a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11517:1875041472034560:192.168.202.2@tcp:105: 00010000:00010000:2.0:1788179159.148303:0:11517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788179159.148344:0:11517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+11:2356:x1875041451078528:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 3696us (4348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179159.148351:0:11517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 81 00000100:00100000:2.0:1788179159.153212:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179159.153277:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451078656 00000100:00100000:3.0:1788179159.153284:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451078656 00002000:00100000:3.0:1788179159.153327:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9bc93b6a7100 x1875041451078656/t0(0) o4->334bb25c-6762-4beb-8a84-3a838cbc7e80@192.168.202.2@tcp:175/0 lens 504/0 e 0 to 0 dl 1788179170 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788179159.153335:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bc93b6a7100 with x1875041451078656 ext(0->12) 00002000:00010000:3.0:1788179159.153339:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bc93b6a7100 00000100:00100000:1.0:1788179159.153443:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:1.0:1788179159.153456:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+11:2356:x1875041451078656:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788179159.153872:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+13:2356:x1875041451078656:12345-192.168.202.2@tcp:4:lhsmtool_posix.0 Request processed in 419us (1032us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788179159.153883:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 6 00002000:00100000:1.0:1788179159.153889:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9bc93b6a7100 x1875041451078656/t4294967320(0) o4->334bb25c-6762-4beb-8a84-3a838cbc7e80@192.168.202.2@tcp:175/0 lens 504/448 e 0 to 0 dl 1788179170 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788179159.153894:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bc93b6a7100 with x1875041451078656 ext(0->12) 00002000:00010000:1.0:1788179159.153897:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bc93b6a7100 00000100:00100000:0.0:1788179159.156233:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179159.156320:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451078784 00000100:00100000:2.0:1788179159.156345:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451078784 00000100:00100000:2.0:1788179159.156504:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 228 00000100:00100000:2.0:1788179159.156517:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+66:11589:x1875041451078784:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788179159.182779:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179159.182822:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179159.182865:0:12275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451079168 00000100:00100000:2.0:1788179159.182874:0:12275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451079168 00000100:00100000:2.0:1788179159.182930:0:12275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 154 00000100:00100000:2.0:1788179159.182940:0:12275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2354:x1875041451079168:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788179159.183038:0:12275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2354:x1875041451079168:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 98us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179159.183047:0:12275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 154 00000100:00080000:2.0:1788179159.183072:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788179159.183111:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179159.183453:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451078912 00000100:00100000:1.0:1788179159.183458:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451078912 00000100:00100000:1.0:1788179159.183492:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 297 00000100:00100000:1.0:1788179159.183499:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2354:x1875041451078912:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179159.183530:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2354:x1875041451078912:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 31us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179159.183536:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 297 00000100:00100000:2.0:1788179159.183907:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451079040 00000100:00100000:2.0:1788179159.183912:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451079040 00000100:00100000:2.0:1788179159.183946:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 92 00000100:00100000:2.0:1788179159.183954:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2354:x1875041451079040:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788179159.183993:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2354:x1875041451079040:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 39us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179159.183999:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 92 00000001:00080000:1.0:1788179159.208975:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:1.0:1788179159.209003:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:0.0:1788179159.209689:0:12430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1788179159.209734:0:12430:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:0.0:1788179159.209783:0:12430:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bc9359ea180 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788179159.209788:0:12430:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9bc9351bfa00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bc9359ea900 00000020:00080000:0.0:1788179159.209791:0:12430:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9bc9351bf800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bc92e12b800 00000020:00080000:0.0:1788179159.209924:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 6 committed batchid 5 00000020:00080000:0.0:1788179159.210094:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788179159.210113:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472034688:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788179159.210328:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179159.210439:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472034688 00000100:00100000:0.0:1788179159.210447:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472034688 00000100:00100000:0.0:1788179159.210502:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788179159.210511:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875041472034688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788179159.210535:0:6590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1788179159.210562:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce65c721/0xaa4c98508c49994b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.210694:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000044300061/0xaa4c98508c49970d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662279 expref: 12 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.210706:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788179159.210710:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788179159.210716:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce65c721/0xaa4c98508c49994b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.210743:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000044300061/0xaa4c98508c49970d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662279 expref: 12 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.210768:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000044300061/0xaa4c98508c49970d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662279 expref: 12 pid: 7778 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179159.210780:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8edc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6590:1875041472034816:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788179159.210842:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc935426540 going to sleep for 11 seconds 00000100:00080000:0.0:1788179159.210869:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788179159.211091:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+28:11589:x1875041451078784:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 Request processed in 54576us (54868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179159.211101:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 228 00000100:00100000:3.0:1788179159.214887:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179159.214937:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179159.215117:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451079424 00000100:00100000:0.0:1788179159.215126:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451079424 00010000:00010000:0.0:1788179159.215220:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000044300061/0xaa4c98508c49970d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662279 expref: 13 pid: 7778 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179159.215260:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 82 00000100:00100000:0.0:1788179159.215269:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+13:2357:x1875041451079424:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179159.215282:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179159.215287:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000044300061/0xaa4c98508c49970d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662279 expref: 13 pid: 7778 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.215300:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000044300061/0xaa4c98508c49970d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662279 expref: 13 pid: 7778 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.215322:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788179159.215326:0:5783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788179159.215332:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce65c721/0xaa4c98508c49994b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.215554:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce65c721/0xaa4c98508c49994b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.215577:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179159.215688:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+13:2357:x1875041451079424:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 410us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179159.215696:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 82 00000100:00100000:0.0:1788179159.215731:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b6a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472034944:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788179159.215767:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788179159.215841:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044300061/0xaa4c98508c49970d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662279 expref: 12 pid: 7778 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179159.215877:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8edc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6590:1875041472034816:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788179159.215896:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ce65c721/0xaa4c98508c49994b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.215907:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ce65c721/0xaa4c98508c49994b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.215914:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce65c721/0xaa4c98508c49994b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.215925:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce65c721/0xaa4c98508c49994b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.215947:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce65c721/0xaa4c98508c49994b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.215964:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:1.0:1788179159.216568:0:5818:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bc9111850c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788179159.216575:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9bc907193a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bc911185000 00000020:00080000:1.0:1788179159.216578:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9bc907193000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bc902f84400 00000100:00100000:1.0:1788179159.216634:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451079296 00000100:00100000:1.0:1788179159.216640:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451079296 00000100:00100000:1.0:1788179159.216671:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472034944 00000100:00100000:1.0:1788179159.216674:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472034944 00000100:00100000:1.0:1788179159.216716:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 66 00000100:00100000:1.0:1788179159.216724:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+12:2357:x1875041451079296:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1788179159.217132:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788179159.217141:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce65c721/0xaa4c98508c49994b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.217233:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f200 already unused, calling callback (ffffffffc1644220) 00010000:00010000:2.0:1788179159.217238:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce65c721/0xaa4c98508c49994b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.217247:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce65c721/0xaa4c98508c49994b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.217263:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce65c721/0xaa4c98508c49994b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.217270:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce65c721/0xaa4c98508c49994b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.217291:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179159.217292:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179159.217294:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788179159.217303:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1788179159.217356:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00080000:0.0:1788179159.217460:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788179159.218500:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1875041472034688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7984us (8165us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788179159.218511:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788179159.218546:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788179159.218556:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472034944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788179159.218583:0:6590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1788179159.218614:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9572d5, atime: 0x6a9572d5, ctime: 0x6a9572d5, blocks: 0xb 00010000:00010000:0.0:1788179159.218620:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e714b189/0xaa4c98508c499952 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.218633:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=355s v=(0 0) 00010000:00010000:0.0:1788179159.218637:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788179159.218644:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e714b189/0xaa4c98508c499952 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.218657:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e714b189/0xaa4c98508c499952 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.218665:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e714b189/0xaa4c98508c499952 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.219309:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e714b189/0xaa4c98508c499952 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.219324:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788179159.219354:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788179159.219420:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e714b189/0xaa4c98508c499952 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.219695:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317fa00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:1.0:1788179159.219700:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e714b189/0xaa4c98508c499952 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.219708:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e714b189/0xaa4c98508c499952 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.219726:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e714b189/0xaa4c98508c499952 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.219733:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e714b189/0xaa4c98508c499952 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.219754:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179159.219756:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179159.219758:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788179159.219927:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bc92e8ec380/2, rc 0, transno 4294967321 00000100:00100000:1.0:1788179159.219940:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472034688:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788179159.220915:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1875041472034944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2357us (5143us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788179159.220926:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788179159.221019:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1788179159.221025:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bc92e6bea00, transno 4294967307 00000004:00080000:1.0:1788179159.221042:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:1.0:1788179159.221064:0:3306:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9bc93b6a4380 x1875041472034944/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788179175 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788179159.221074:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bc93b6a4380/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788179159.221086:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b6a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472034944:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1788179159.235013:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:0.0:1788179159.235044:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000100:00100000:1.0:1788179159.235094:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2357:x1875041451079296:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 Request processed in 18365us (20209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179159.235106:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 66 00000100:00100000:2.0:1788179159.236890:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179159.236938:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451079680 00000100:00100000:1.0:1788179159.236948:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451079680 00000100:00100000:0.0:1788179159.237070:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 229 00000100:00100000:0.0:1788179159.237079:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+20:11589:x1875041451079680:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788179159.237132:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179159.237160:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c499936 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466230c expref: 20 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.237176:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bc909481e00) 00010000:00010000:0.0:1788179159.237180:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788179159.237205:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499959 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.237215:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499959 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.237222:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499959 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788179159.237474:0:5798:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e4f27a8b reply state 000000009e9daece transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499959 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179159.237493:0:5798:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788179159.237573:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+21:11589:x1875041451079680:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 495us (725us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788179159.237578:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 229 00010000:00010000:1.0:1788179159.239110:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499959 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.239124:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499959 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.239130:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499959 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.239137:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317fa00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179159.239142:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499959 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.239149:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499959 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.239163:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bc909481e00) 00010000:00010000:1.0:1788179159.239167:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179159.239170:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499959 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.239174:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499959 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179159.239482:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179159.239533:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451079808 00000100:00100000:3.0:1788179159.239542:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451079808 00000100:00100000:3.0:1788179159.239660:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 68 00000100:00100000:3.0:1788179159.239671:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2356:x1875041451079808:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788179159.239961:0:6589:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788179159.239966:0:6589:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788179158 00002000:00010000:3.0:1788179159.239968:0:6589:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788179157 00002000:00010000:3.0:1788179159.239970:0:6589:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788179158 -> 1788179158 00002000:00010000:3.0:1788179159.239973:0:6589:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788179159.240030:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2356:x1875041451079808:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 360us (550us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788179159.240038:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 68 00000100:00100000:2.0:1788179159.241710:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179159.241797:0:12275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451080064 00000100:00100000:3.0:1788179159.241806:0:12275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451080064 00000100:00100000:3.0:1788179159.241974:0:12275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 230 00000100:00100000:3.0:1788179159.241982:0:12275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+20:11589:x1875041451080064:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788179159.242055:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499960 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.242088:0:12275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49991a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622fe expref: 20 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.242095:0:12275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499960 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.242129:0:12275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49991a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746622fe expref: 20 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.242143:0:12275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49991a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746622fe expref: 20 pid: 5797 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179159.242159:0:12275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f878a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12275:1875041472035072:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788179159.242229:0:12275:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc8013bfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788179159.243551:0:12275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f878a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12275:1875041472035072:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788179159.243570:0:12275:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499960 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179159.244713:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179159.244760:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451080192 00000100:00100000:3.0:1788179159.244767:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451080192 00010000:00010000:3.0:1788179159.244799:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49991a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746622fe expref: 21 pid: 5797 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179159.244830:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 83 00000100:00100000:3.0:1788179159.244839:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+21:2356:x1875041451080192:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788179159.244892:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179159.244915:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49991a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746622fe expref: 21 pid: 5797 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.244928:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49991a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746622fe expref: 21 pid: 5797 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.244949:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49991a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746622fe expref: 21 pid: 5797 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.244962:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bc909481e00) 00010000:00010000:3.0:1788179159.244965:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499960 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.244971:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499960 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.244976:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499960 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.245085:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788179159.245103:0:12275:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499960 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.245109:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499960 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.245150:0:12275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499960 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.245158:0:12275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499960 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.245164:0:12275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499960 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179159.245176:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+20:2356:x1875041451080192:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 337us (469us total) trans 0 rc 0/0 00010000:00010000:3.0:1788179159.245177:0:12275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5600 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179159.245182:0:12275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499960 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179159.245184:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 83 00010000:00010000:3.0:1788179159.245190:0:12275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499960 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.245198:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bc909481e00) 00010000:00010000:3.0:1788179159.245200:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788179159.245204:0:12275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499960 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.245210:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c499960 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179159.245246:0:12275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+19:11589:x1875041451080064:12345-192.168.202.2@tcp:55:lhsmtool_posix.0 Request processed in 3265us (3547us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788179159.245254:0:12275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 230 00000100:00100000:0.0:1788179159.246999:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179159.247127:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451080320 00000100:00100000:2.0:1788179159.247136:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451080320 00000100:00100000:2.0:1788179159.247191:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 69 00000100:00100000:2.0:1788179159.247202:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2357:x1875041451080320:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788179159.247251:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bda46389/0xaa4c98508c499967 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.247273:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea62733c/0xaa4c98508c499944 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466231a expref: 8 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.247280:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179159.247283:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788179159.247287:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bda46389/0xaa4c98508c499967 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.247314:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea62733c/0xaa4c98508c499944 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466231a expref: 8 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.247324:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea62733c/0xaa4c98508c499944 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466231a expref: 8 pid: 7778 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179159.247335:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f7f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6590:1875041472035200:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788179159.247492:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9013776c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788179159.250839:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f7f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6590:1875041472035200:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788179159.250905:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bda46389/0xaa4c98508c499967 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179159.251691:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179159.251751:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451080448 00000100:00100000:2.0:1788179159.251758:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451080448 00010000:00010000:2.0:1788179159.251787:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ea62733c/0xaa4c98508c499944 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466231a expref: 9 pid: 7778 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179159.251816:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 84 00000100:00100000:2.0:1788179159.251823:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+9:2356:x1875041451080448:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788179159.251835:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179159.251873:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea62733c/0xaa4c98508c499944 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466231a expref: 9 pid: 7778 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.251886:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea62733c/0xaa4c98508c499944 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466231a expref: 9 pid: 7778 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.251908:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea62733c/0xaa4c98508c499944 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466231a expref: 9 pid: 7778 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.251921:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788179159.251924:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788179159.251928:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bda46389/0xaa4c98508c499967 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.251934:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bda46389/0xaa4c98508c499967 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.251969:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788179159.251998:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bda46389/0xaa4c98508c499967 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.252006:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bda46389/0xaa4c98508c499967 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.252031:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bda46389/0xaa4c98508c499967 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.252040:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bda46389/0xaa4c98508c499967 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.252055:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bda46389/0xaa4c98508c499967 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.252063:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5800 already unused, calling callback (ffffffffc1644220) 00010000:00010000:3.0:1788179159.252066:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bda46389/0xaa4c98508c499967 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.252076:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bda46389/0xaa4c98508c499967 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.252087:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bda46389/0xaa4c98508c499967 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.252094:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bda46389/0xaa4c98508c499967 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179159.252104:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2356:x1875041451080448:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 281us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179159.252111:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 84 00000100:00100000:3.0:1788179159.252202:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2357:x1875041451080320:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 Request processed in 5002us (5212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179159.252210:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 69 00000100:00100000:0.0:1788179159.253739:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179159.253792:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451080704 00000100:00100000:2.0:1788179159.253799:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451080704 00000100:00100000:2.0:1788179159.253839:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 231 00000100:00100000:2.0:1788179159.253878:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90703a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+19:11589:x1875041451080704:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788179159.253942:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49996e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.253956:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49996e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.253963:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49996e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.254148:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499975 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.254159:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499928 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662305 expref: 20 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.254168:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499975 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.254199:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499928 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662305 expref: 20 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.254223:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499928 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662305 expref: 20 pid: 12275 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179159.254234:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f7f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1875041472035328:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788179159.254292:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9013776c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788179159.256086:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f7f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1875041472035328:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788179159.256111:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499975 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179159.258051:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179159.259114:0:11517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451080832 00000100:00100000:2.0:1788179159.259126:0:11517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451080832 00010000:00010000:2.0:1788179159.259173:0:11517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499928 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662305 expref: 21 pid: 12275 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179159.259239:0:11517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 85 00000100:00100000:2.0:1788179159.259246:0:11517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90703b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+21:2356:x1875041451080832:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788179159.259260:0:11517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179159.259265:0:11517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499928 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662305 expref: 21 pid: 12275 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.259275:0:11517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499928 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662305 expref: 21 pid: 12275 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.259295:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499928 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662305 expref: 21 pid: 12275 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.259325:0:11517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bc909481e00) 00010000:00010000:2.0:1788179159.259329:0:11517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499975 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.259337:0:11517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499975 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.259342:0:11517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499975 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.259373:0:11517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788179159.259431:0:11517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90703b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+20:2356:x1875041451080832:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 185us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179159.259436:0:11517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 85 00010000:00010000:3.0:1788179159.260279:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499975 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.260289:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499975 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788179159.260495:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1788179159.260652:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1788179159.260697:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1788179159.260776:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f878a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5797:1875041472035456:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788179159.260829:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179159.261011:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472035456 00000100:00100000:2.0:1788179159.261019:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472035456 00000100:00100000:2.0:1788179159.261073:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788179159.261083:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5797:x1875041472035456:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788179159.261153:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc8013bff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788179159.261164:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5797:x1875041472035456:12345-0@lo:1000:mdt00_001.0 Request processed in 83us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179159.261170:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788179159.261173:0:5797:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:3.0:1788179159.261177:0:5797:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:3.0:1788179159.261203:0:5797:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9bc92e8ec380 x1875041472034688/t4294967321(4294967321) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788179175 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179159.261216:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f878a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5797:1875041472035456:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788179159.261642:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1788179159.261698:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b68ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5797:1875041472035584:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788179159.261733:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179159.261759:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc8013bfb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788179159.262068:0:12320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472035584 00000100:00100000:2.0:1788179159.262073:0:12320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472035584 00000100:00100000:2.0:1788179159.262139:0:12320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788179159.262148:0:12320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5797:x1875041472035584:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788179159.262281:0:12320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5797:x1875041472035584:12345-0@lo:1000:mdt00_001.0 Request processed in 136us (549us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788179159.262294:0:12320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788179159.262340:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b68ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5797:1875041472035584:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788179159.262366:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499975 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.262375:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499975 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.262382:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499975 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.262388:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179159.262393:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499975 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.262401:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499975 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.262423:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bc909481e00) 00010000:00010000:3.0:1788179159.262427:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788179159.262432:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499975 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.262439:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c499975 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.262482:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c4998b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.262489:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c4998b8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.262495:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c4998b8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.262500:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92e12d000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179159.262503:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c4998b8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.262509:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c4998b8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.262517:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:3.0:1788179159.262520:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788179159.262525:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c4998bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622e9 expref: 23 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.262532:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c4998bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622e9 expref: 23 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.262543:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c4998bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622e9 expref: 23 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.262568:0:5797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c4998bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622e9 expref: 23 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179159.262579:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b6a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1875041472035712:192.168.202.2@tcp:105: 00000100:00100000:3.0:1788179159.262659:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc8013bfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788179159.264736:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b6a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5797:1875041472035712:192.168.202.2@tcp:105: 00010000:00010000:3.0:1788179159.264766:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c4998b8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.264776:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d000/0xaa4c98508c4998b8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.264806:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c49997c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.264818:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c49997c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.264829:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c49997c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.264839:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c49997c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.264844:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c49997c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.265545:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c49997c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.265552:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5600 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179159.265556:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c49997c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.265563:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c49997c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.265576:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:3.0:1788179159.265579:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179159.265582:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c49997c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.265596:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c49997c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.265607:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49996e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.265614:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49996e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.265619:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49996e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.265624:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c4a00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179159.265627:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49996e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.265642:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49996e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.265650:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:3.0:1788179159.265652:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788179159.265654:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49996e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.265660:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4a00/0xaa4c98508c49996e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788179159.266065:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788179159.266070:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788179159.266558:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788179159.266567:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788179159.266898:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90703a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+23:11589:x1875041451080704:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 13046us (13157us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1788179159.266910:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 231 00000020:00080000:3.0:1788179159.266916:0:5797:0:(tgt_main.c:811:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788179159.267627:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179159.267888:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451080960 00000100:00100000:2.0:1788179159.267897:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451080960 00000100:00100000:2.0:1788179159.267942:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:2.0:1788179159.267952:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+23:11588:x1875041451080960:12345-192.168.202.2@tcp:49:lfs.0 00000100:00100000:2.0:1788179159.268222:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+23:11588:x1875041451080960:12345-192.168.202.2@tcp:49:lfs.0 Request processed in 270us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179159.268229:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 61 00000100:00100000:1.0:1788179159.272806:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179159.272916:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451081216 00000100:00100000:2.0:1788179159.272926:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451081216 00000100:00100000:2.0:1788179159.272984:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 62 00000100:00100000:2.0:1788179159.272994:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9071ef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+23:11589:x1875041451081216:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788179159.274102:0:5799:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788179159.274213:0:5799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1788179159.274266:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499983 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.274284:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499983 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.274297:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499983 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.274304:0:5799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499983 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.274311:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499983 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.274328:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499983 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179159.274347:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788179159.274449:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9071ef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+25:11589:x1875041451081216:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 1453us (1651us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1788179159.274458:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 62 00000020:00080000:2.0:1788179159.274463:0:5799:0:(tgt_main.c:811:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788179159.274711:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788179159.274718:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499983 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.274725:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c4000 already unused, calling callback (ffffffffc1644220) 00010000:00010000:1.0:1788179159.274729:0:6606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499983 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.274736:0:6606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499983 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.274747:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9bc909481d00) 00010000:00010000:1.0:1788179159.274750:0:6606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788179159.274754:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499983 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.274760:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4000/0xaa4c98508c499983 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179159.274787:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179159.274789:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179159.274791:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179159.276821:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179159.277084:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451081472 00000100:00100000:2.0:1788179159.277094:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451081472 00000100:00100000:2.0:1788179159.277178:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 232 00000100:00100000:2.0:1788179159.277188:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90703a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+25:11588:x1875041451081472:12345-192.168.202.2@tcp:58:lfs.0 00000040:00080000:2.0:1788179159.277421:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788179159.277515:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90703a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+25:11588:x1875041451081472:12345-192.168.202.2@tcp:58:lfs.0 Request processed in 327us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179159.277521:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 232 00010000:00010000:3.0:1788179159.296213:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179159.305493:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179159.305577:0:12275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451081600 00000100:00100000:3.0:1788179159.305587:0:12275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451081600 00000100:00100000:3.0:1788179159.305645:0:12275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 233 00000100:00100000:3.0:1788179159.305655:0:12275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+25:11593:x1875041451081600:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:3.0:1788179159.305708:0:12275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179159.305740:0:12275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c49998a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662321 expref: -99 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.305813:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499991 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.305827:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499991 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.305898:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499991 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.305915:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c499998 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.305923:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c499998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.305929:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c499998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.306195:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c49999f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.306205:0:12275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4998aa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622e2 expref: 26 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.306212:0:12275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c49999f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.306243:0:12275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4998aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746622e2 expref: 26 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.306257:0:12275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4998aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746622e2 expref: 26 pid: 5827 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179159.306271:0:12275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b6a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12275:1875041472035840:192.168.202.2@tcp:104: 00000100:00100000:3.0:1788179159.306344:0:12275:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc8013bf840 going to sleep for 11 seconds 00000100:00100000:3.0:1788179159.311487:0:12275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b6a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12275:1875041472035840:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788179159.311520:0:12275:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c49999f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179159.312429:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179159.312550:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451081856 00000100:00100000:2.0:1788179159.312559:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451081856 00000100:00100000:2.0:1788179159.312618:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00100000:2.0:1788179159.312628:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+27:5570:x1875041451081856:12345-192.168.202.2@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788179159.312844:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+28:5570:x1875041451081856:12345-192.168.202.2@tcp:35:ldlm_bl.0 Request processed in 218us (419us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788179159.312871:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 63 00000100:00100000:1.0:1788179159.314548:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179159.314622:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451081984 00000100:00100000:0.0:1788179159.314629:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451081984 00010000:00010000:0.0:1788179159.314660:0:5783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4998aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746622e2 expref: 28 pid: 5827 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179159.314701:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 86 00000100:00100000:0.0:1788179159.314710:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+28:2357:x1875041451081984:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179159.314723:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179159.314729:0:5783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4998aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746622e2 expref: 28 pid: 5827 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.314760:0:5783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4998aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746622e2 expref: 28 pid: 5827 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.314784:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4998aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746622e2 expref: 28 pid: 5827 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.314801:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:0.0:1788179159.314806:0:5783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c49999f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.314813:0:5783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c49999f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.314819:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c49999f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179159.314840:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179159.314903:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+27:2357:x1875041451081984:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 195us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179159.314908:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 86 00010000:00010000:3.0:1788179159.315340:0:12275:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c49999f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.315348:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c49999f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179159.315398:0:12275:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788179159.315402:0:12275:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788179159.315417:0:12275:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c49999f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.315538:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c49999f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.315550:0:12275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499991 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.315556:0:12275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499991 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.315562:0:12275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499991 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.315568:0:12275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5e00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179159.315572:0:12275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499991 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.315578:0:12275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499991 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.315605:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:3.0:1788179159.315608:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179159.315612:0:12275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499991 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.315618:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499991 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.315707:0:12275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c499998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.315714:0:12275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c499998 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.315719:0:12275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c499998 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.315723:0:12275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179159.315729:0:12275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c499998 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.315734:0:12275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c499998 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.315741:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9bc902d54500) 00010000:00010000:3.0:1788179159.315743:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179159.315746:0:12275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c499998 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.315752:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5000/0xaa4c98508c499998 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.315791:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5600/0xaa4c98508c49998a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662321 expref: 27 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.315802:0:12275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c49999f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662321 expref: 26 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179159.315809:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:3.0:1788179159.315811:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788179159.315813:0:12275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b5a00, rc 0) 00000100:00100000:3.0:1788179159.316345:0:12275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+26:11593:x1875041451081600:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 10690us (10861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179159.316350:0:12275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 233 00000040:00080000:0.0:1788179160.229483:0:12470:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788179160.229492:0:12470:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788179160.229535:0:12470:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788179160.229541:0:12470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788179160.324174:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788179160.324183:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788179160.324222:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788179160.324230:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788179160.324351:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9359bbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1875041472035968:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788179160.324445:0:11535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93fad9540 going to sleep for 11 seconds 00010000:00010000:3.0:1788179160.329748:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788179160.330250:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179160.330462:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451082112 00000100:00100000:3.0:1788179160.330472:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451082112 00000100:00100000:3.0:1788179160.330534:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 234 00000100:00100000:3.0:1788179160.330543:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+27:11605:x1875041451082112:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788179160.330600:0:5797:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788179160.330720:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+27:11605:x1875041451082112:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 177us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179160.330727:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 234 00000100:00100000:0.0:1788179160.331009:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9359bbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1875041472035968:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788179160.347796:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179160.347830:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451082368 00000100:00100000:0.0:1788179160.347864:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451082368 00000100:00100000:0.0:1788179160.347921:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 235 00000100:00100000:0.0:1788179160.347931:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+26:11605:x1875041451082368:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788179160.347952:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179160.347973:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4999a6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662328 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179160.348074:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4999ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179160.348089:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4999ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179160.348102:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4999ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179160.348112:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788179160.348237:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4999a6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662328 expref: 29 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179160.348253:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4999ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662328 expref: 28 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179160.348262:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:0.0:1788179160.348265:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788179160.348269:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317e200, rc 0) 00000100:00100000:0.0:1788179160.348324:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+28:11605:x1875041451082368:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 394us (534us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1788179160.348332:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 235 00000100:00100000:2.0:1788179160.359869:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179160.360096:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451082496 00000100:00100000:0.0:1788179160.360106:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451082496 00000100:00100000:0.0:1788179160.360164:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:0.0:1788179160.360174:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90710f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+28:2357:x1875041451082496:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179160.360192:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179160.360217:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4999ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662328 expref: 28 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179160.360233:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:0.0:1788179160.360237:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179160.360296:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90710f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+27:2357:x1875041451082496:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 123us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179160.360303:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:2.0:1788179160.362151:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179160.363882:0:12275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451082752 00000100:00100000:0.0:1788179160.363892:0:12275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451082752 00000100:00100000:0.0:1788179160.363944:0:12275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 236 00000100:00100000:0.0:1788179160.363953:0:12275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+27:11605:x1875041451082752:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788179160.364023:0:12275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4999bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179160.364040:0:12275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4999bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179160.364051:0:12275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4999bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179160.364238:0:12275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4999bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179160.364256:0:12275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4999bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179160.364263:0:12275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4999bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179160.364268:0:12275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179160.364273:0:12275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4999bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179160.364280:0:12275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4999bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179160.364292:0:12275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:0.0:1788179160.364294:0:12275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788179160.364299:0:12275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4999bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179160.364305:0:12275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4999bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179160.364430:0:12275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+28:11605:x1875041451082752:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 477us (2284us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788179160.364437:0:12275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 236 00000040:00080000:0.0:1788179160.364711:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788179160.364716:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788179160.367186:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788179160.367202:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788179160.370559:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179160.370649:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451083008 00000100:00100000:2.0:1788179160.370659:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451083008 00000100:00100000:2.0:1788179160.370753:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 64 00000100:00100000:2.0:1788179160.370764:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+28:11605:x1875041451083008:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788179160.371036:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+29:11605:x1875041451083008:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 273us (484us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788179160.371044:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 64 00010000:00010000:1.0:1788179161.344305:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788179161.792916:0:6811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 357856063789ns, next at 358856061229ns, rc = 0 00000100:00100000:1.0:1788179161.792932:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788179161.792953:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b6a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472036096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788179161.793019:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179161.797453:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472036096 00000100:00100000:3.0:1788179161.797468:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472036096 00000100:00100000:3.0:1788179161.797545:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788179161.797559:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875041472036096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788179161.797610:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788179161.797719:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875041472036096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (4698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179161.797727:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1788179161.799732:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788179161.803533:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b6a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472036096:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788179162.280954:0:12521:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788179162.280965:0:12521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788179162.281019:0:12521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788179162.281025:0:12521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788179162.378220:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788179162.695227:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179162.695267:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451083264 00000100:00100000:2.0:1788179162.695277:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451083264 00000100:00100000:2.0:1788179162.695336:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 237 00000100:00100000:2.0:1788179162.695347:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+29:11625:x1875041451083264:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788179162.695372:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179162.695394:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4999c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466232f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179162.695492:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c4999c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179162.695507:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c4999c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179162.695518:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c4999c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179162.695528:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788179162.695776:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5800/0xaa4c98508c4999c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466232f expref: 32 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179162.695808:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c4999c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466232f expref: 31 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179162.695817:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:2.0:1788179162.695821:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788179162.695824:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c5000, rc 0) 00000100:00100000:2.0:1788179162.695894:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+31:11625:x1875041451083264:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 548us (675us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788179162.695901:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 237 00000100:00080000:2.0:1788179162.695920:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788179162.722170:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179162.722317:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451083392 00000100:00100000:0.0:1788179162.722328:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451083392 00000100:00100000:0.0:1788179162.722384:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 238 00000100:00100000:0.0:1788179162.722394:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f6de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+31:11625:x1875041451083392:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:0.0:1788179162.722462:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4999d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179162.722480:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4999d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179162.722492:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4999d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179162.722518:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4999d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179162.722525:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4999d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179162.722531:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4999d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179162.722538:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317ee00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179162.722542:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4999d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179162.722550:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4999d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179162.722561:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:0.0:1788179162.722577:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788179162.722582:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4999d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179162.722589:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c4999d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179162.722669:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f6de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+31:11625:x1875041451083392:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 276us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179162.722677:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 238 00000100:00100000:1.0:1788179162.817063:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc90703b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041472036224:0@lo:400:kworker.0 00000100:00100000:1.0:1788179162.817159:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179162.817321:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472036224 00000100:00100000:0.0:1788179162.817329:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472036224 00000100:00100000:0.0:1788179162.817377:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788179162.817388:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:3308:x1875041472036224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179162.817455:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:3308:x1875041472036224:12345-0@lo:400:kworker.0 Request processed in 69us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179162.817464:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788179162.817659:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc90703b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041472036224:0@lo:400:kworker.0 00000100:00100000:1.0:1788179162.817667:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041472036736:0@lo:400:kworker.0 00000100:00100000:1.0:1788179162.817695:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179162.817731:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788179162.817737:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472036608:0@lo:400:kworker.0 00000100:00100000:1.0:1788179162.817762:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179162.817792:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875041472036480:0@lo:400:kworker.0 00000100:00100000:1.0:1788179162.817815:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179162.817834:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788179162.817840:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875041472036352:0@lo:400:kworker.0 00000100:00100000:1.0:1788179162.817881:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179162.817898:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472036864:0@lo:400:kworker.0 00000100:00100000:1.0:1788179162.817918:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179162.817950:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472036608 00000100:00100000:1.0:1788179162.817954:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472036608 00000100:00100000:1.0:1788179162.817996:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472036864 00000100:00100000:1.0:1788179162.817999:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472036864 00000100:00100000:1.0:1788179162.818030:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788179162.818036:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1875041472036608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179162.818085:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1875041472036608:12345-0@lo:400:kworker.0 Request processed in 49us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179162.818092:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788179162.818104:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788179162.818110:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1875041472036864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179162.818310:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1875041472036864:12345-0@lo:400:kworker.0 Request processed in 199us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179162.818316:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788179162.818333:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472036736 00000100:00100000:1.0:1788179162.818337:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472036736 00000100:00100000:1.0:1788179162.818362:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472036480 00000100:00100000:1.0:1788179162.818364:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472036480 00000100:00100000:1.0:1788179162.818381:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472036352 00000100:00100000:1.0:1788179162.818384:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472036352 00000100:00100000:1.0:1788179162.818396:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788179162.818402:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041472036736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179162.819064:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875041472036736:12345-0@lo:400:kworker.0 Request processed in 660us (1366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179162.819071:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788179162.819098:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788179162.819105:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90703b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875041472036480:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788179162.819395:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788179162.819401:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788179162.819418:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788179162.819441:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc910b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875041472036352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179162.826633:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472036864:0@lo:400:kworker.0 00000100:00100000:3.0:1788179162.826699:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472036608:0@lo:400:kworker.0 00000100:00100000:3.0:1788179162.826712:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1875041472036736:0@lo:400:kworker.0 00000100:00100000:2.0:1788179162.826943:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc910b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875041472036352:12345-0@lo:400:kworker.0 Request processed in 7516us (9058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179162.826955:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788179162.830228:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875041472036352:0@lo:400:kworker.0 00000100:00100000:3.0:1788179162.833575:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875041472036480:0@lo:400:kworker.0 00000100:00100000:1.0:1788179162.833699:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90703b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875041472036480:12345-0@lo:400:kworker.0 Request processed in 14585us (15873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179162.833712:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788179162.844065:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179162.845740:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451083520 00000100:00100000:1.0:1788179162.845755:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451083520 00000100:00100000:1.0:1788179162.845891:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 70 00000100:00100000:1.0:1788179162.845917:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2356:x1875041451083520:12345-192.168.202.2@tcp:101:cat.0 00010000:00010000:1.0:1788179162.845937:0:7778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179162.845957:0:7778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff411512/0xaa4c98508c4999de lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662336 expref: -99 pid: 7778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788179162.845995:0:7778:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9572d6, atime: 0x6a9572d5, ctime: 0x6a9572d6, blocks: 0xb 00010000:00010000:1.0:1788179162.846017:0:7778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=358s v=(0 0) 00010000:00010000:1.0:1788179162.846021:0:7778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179162.846031:0:7778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff411512/0xaa4c98508c4999de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662336 expref: 8 pid: 7778 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179162.846047:0:7778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff411512/0xaa4c98508c4999de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662336 expref: 8 pid: 7778 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179162.846060:0:7778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc92e12de00, rc 0) 00000100:00080000:2.0:1788179162.846471:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788179162.846563:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2356:x1875041451083520:12345-192.168.202.2@tcp:101:cat.0 Request processed in 638us (2498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179162.846571:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 70 00000100:00100000:2.0:1788179162.851519:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179162.852031:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451083648 00000100:00100000:1.0:1788179162.852042:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451083648 00002000:00100000:1.0:1788179162.852098:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9bc934bf8a80 x1875041451083648/t0(0) o3->334bb25c-6762-4beb-8a84-3a838cbc7e80@192.168.202.2@tcp:178/0 lens 488/0 e 0 to 0 dl 1788179173 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788179162.852115:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bc934bf8a80 with x1875041451083648 ext(0->4095) 00002000:00010000:1.0:1788179162.852188:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bc934bf8a80 00000100:00100000:1.0:1788179162.852294:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:1.0:1788179162.852305:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2356:x1875041451083648:12345-192.168.202.2@tcp:3:cat.0 00000100:00100000:1.0:1788179162.852719:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2356:x1875041451083648:12345-192.168.202.2@tcp:3:cat.0 Request processed in 415us (1215us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788179162.852734:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00002000:00100000:1.0:1788179162.852741:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9bc934bf8a80 x1875041451083648/t0(0) o3->334bb25c-6762-4beb-8a84-3a838cbc7e80@192.168.202.2@tcp:178/0 lens 488/4536 e 0 to 0 dl 1788179173 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788179162.852749:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9bc934bf8a80 with x1875041451083648 ext(0->4095) 00002000:00010000:1.0:1788179162.852752:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9bc934bf8a80 00000100:00100000:1.0:1788179163.337055:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b6a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472036992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788179163.337149:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179163.337342:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472036992 00000100:00100000:3.0:1788179163.337360:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472036992 00000100:00100000:3.0:1788179163.337426:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788179163.337437:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875041472036992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788179163.337471:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788179163.365765:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875041472036992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 28317us (28603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179163.365781:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788179163.366128:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b6a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472036992:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788179163.393538:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788179163.936490:0:7496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:0.0:1788179164.303708:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179164.303756:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179164.303781:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179164.303802:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179164.303824:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179164.303870:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451083904 00000100:00100000:0.0:1788179164.303880:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451083904 00000100:00100000:0.0:1788179164.303951:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451084288 00000100:00100000:0.0:1788179164.303955:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451084288 00000100:00100000:0.0:1788179164.304105:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 158 00000100:00100000:0.0:1788179164.304115:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+31:2354:x1875041451083904:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179164.304179:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+31:2354:x1875041451083904:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 65us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179164.304198:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 158 00000100:00100000:0.0:1788179164.304220:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 159 00000100:00100000:0.0:1788179164.304227:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2355:x1875041451084288:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179164.304253:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:2355:x1875041451084288:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 27us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179164.304259:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 159 00000100:00100000:0.0:1788179164.304278:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451084032 00000100:00100000:0.0:1788179164.304281:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451084032 00000100:00100000:0.0:1788179164.304306:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451084160 00000100:00100000:0.0:1788179164.304309:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451084160 00000100:00100000:0.0:1788179164.304331:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 95 00000100:00100000:0.0:1788179164.304337:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2355:x1875041451084032:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179164.304364:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+8:2355:x1875041451084032:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 26us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179164.304370:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 95 00000100:00100000:0.0:1788179164.304383:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 96 00000100:00100000:0.0:1788179164.304389:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2354:x1875041451084160:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179164.304412:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2354:x1875041451084160:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 23us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179164.304419:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 96 00000100:00080000:0.0:1788179164.304611:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788179164.304615:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788179164.304618:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788179164.315232:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451083776 00000100:00100000:3.0:1788179164.315257:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451083776 00000100:00100000:3.0:1788179164.315331:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 299 00000100:00100000:3.0:1788179164.315339:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2355:x1875041451083776:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788179164.315421:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2355:x1875041451083776:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 82us (11722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179164.315443:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 299 00010000:00010000:2.0:1788179164.419988:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788179164.528803:0:12430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000020:00080000:0.0:1788179164.528822:0:12430:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 6 batchid updated 00000001:00080000:0.0:1788179164.528913:0:12429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1788179164.528931:0:12429:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000004:00080000:0.0:1788179164.528956:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:0.0:1788179164.528976:0:5818:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9bc8013bff00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788179164.528981:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9bc9351bfc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9bc8013bf6c0 00000020:00080000:0.0:1788179164.528984:0:5818:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9bc9351bf200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9bc902f84400 00000100:00100000:0.0:1788179164.529062:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788179164.529082:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472037120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788179164.529151:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179164.529214:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472037120 00000100:00100000:0.0:1788179164.529220:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472037120 00000100:00100000:0.0:1788179164.529269:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788179164.531171:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fcf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1875041472037120:12345-0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1788179164.532204:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788179164.532390:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00002000:00010000:0.0:1788179164.533820:0:6591:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788179164.533826:0:6591:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788179158 -> 1788179158 00002000:00010000:0.0:1788179164.533828:0:6591:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1788179157 -> 1788179157 00002000:00010000:0.0:1788179164.533830:0:6591:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788179158 -> 1788179158 00002000:00010000:0.0:1788179164.533832:0:6591:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788179164.533938:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fcf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3308:x1875041472037120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2774us (4782us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788179164.533948:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1788179164.533988:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788179164.535466:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bc92e0f6680/2, rc 0, transno 4294967324 00000100:00100000:3.0:1788179164.535476:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472037120:0@lo:2:osp-syn-0-0.0 00000001:00080000:2.0:1788179164.645237:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:2.0:1788179164.645266:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:2.0:1788179164.645284:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00010000:00010000:1.0:1788179165.440749:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179166.464213:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788179166.540599:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788179166.540618:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788179166.540910:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1788179166.540919:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788179166.916612:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472037248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788179166.916685:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179166.916763:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472037248 00000100:00100000:2.0:1788179166.916771:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472037248 00000100:00100000:2.0:1788179166.916817:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788179166.916827:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875041472037248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788179166.916879:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179166.916921:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875041472037248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179166.916928:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1788179166.916958:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788179166.916987:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:2.0:1788179166.916992:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bc92e8ec380, transno 4294967321 00000004:00080000:2.0:1788179166.917003:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:2.0:1788179166.917024:0:3308:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9bc92e0f6680 x1875041472037120/t4294967324(4294967324) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788179180 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179166.917040:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472037248:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788179167.488282:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179167.936314:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e6bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875041472037632:0@lo:400:kworker.0 00000100:00100000:0.0:1788179167.936387:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179167.936477:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e6bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472037760:0@lo:400:kworker.0 00000100:00100000:0.0:1788179167.936505:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179167.936550:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472037760 00000100:00100000:0.0:1788179167.936558:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472037760 00000100:00100000:0.0:1788179167.936617:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788179167.936626:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90121b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1875041472037760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179167.936675:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90121b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1875041472037760:12345-0@lo:400:kworker.0 Request processed in 50us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179167.936682:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788179167.936742:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e6bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472037760:0@lo:400:kworker.0 00000100:00100000:3.0:1788179167.936887:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93fcf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041472037376:0@lo:400:kworker.0 00000100:00100000:3.0:1788179167.936935:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179167.936972:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc90121b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875041472037888:0@lo:400:kworker.0 00000100:00100000:3.0:1788179167.936994:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179167.937012:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788179167.937017:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93fcf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041472037504:0@lo:400:kworker.0 00000100:00100000:3.0:1788179167.937034:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179167.937048:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc90121b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472038016:0@lo:400:kworker.0 00000100:00100000:3.0:1788179167.937064:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179167.937085:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472037632 00000100:00100000:3.0:1788179167.937088:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472037632 00000100:00100000:3.0:1788179167.937118:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472037888 00000100:00100000:3.0:1788179167.937121:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472037888 00000100:00100000:3.0:1788179167.937137:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472037504 00000100:00100000:3.0:1788179167.937139:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472037504 00000100:00100000:3.0:1788179167.937151:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788179167.937156:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e6bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875041472037632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179167.937192:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e6bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875041472037632:12345-0@lo:400:kworker.0 Request processed in 35us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179167.937197:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788179167.937209:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788179167.937222:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875041472037888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179167.937266:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875041472037888:12345-0@lo:400:kworker.0 Request processed in 45us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179167.937272:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788179167.937286:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788179167.937292:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041472037504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179167.937317:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041472037504:12345-0@lo:400:kworker.0 Request processed in 26us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179167.937323:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788179167.937343:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472038016 00000100:00100000:3.0:1788179167.937346:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472038016 00000100:00100000:3.0:1788179167.937371:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788179167.937377:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472038016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179167.937405:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472038016:12345-0@lo:400:kworker.0 Request processed in 28us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179167.937411:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1788179167.937425:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788179167.937429:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788179167.937457:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e6bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875041472037632:0@lo:400:kworker.0 00000100:00100000:3.0:1788179167.937478:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93fcf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041472037504:0@lo:400:kworker.0 00000100:00100000:3.0:1788179167.937485:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788179167.937491:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bc93b6a4380, transno 4294967310 00000100:00100000:3.0:1788179167.937502:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc90121b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472038016:0@lo:400:kworker.0 00000100:00100000:3.0:1788179167.937511:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc90121b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875041472037888:0@lo:400:kworker.0 00000100:00100000:0.0:1788179167.939101:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472037376 00000100:00100000:0.0:1788179167.939111:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472037376 00000100:00100000:0.0:1788179167.939157:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788179167.939165:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:3305:x1875041472037376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179167.939234:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efc6f743-3303-46d5-8807-513b82cac1cc+19:3305:x1875041472037376:12345-0@lo:400:kworker.0 Request processed in 69us (2309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179167.939241:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788179167.939329:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93fcf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041472037376:0@lo:400:kworker.0 00000100:00100000:1.0:1788179168.448173:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788179168.448199:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b6a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472038144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788179168.448269:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179168.448449:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472038144 00000100:00100000:2.0:1788179168.448458:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472038144 00000100:00100000:2.0:1788179168.448510:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788179168.448520:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472038144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788179168.448596:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179168.448652:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472038144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179168.448659:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788179168.448977:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b6a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472038144:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788179168.519095:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179168.989659:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179168.990045:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451084416 00000100:00100000:3.0:1788179168.990063:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451084416 00000100:00100000:3.0:1788179168.990232:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 239 00000100:00100000:3.0:1788179168.990244:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+18:11269:x1875041451084416:12345-192.168.202.2@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788179168.990353:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+18:11269:x1875041451084416:12345-192.168.202.2@tcp:60:lhsmtool_posix.0 Request processed in 110us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179168.990360:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 239 00000100:00080000:2.0:1788179168.990476:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788179169.002904:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179169.002992:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451084672 00000100:00100000:2.0:1788179169.003003:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451084672 00000100:00100000:2.0:1788179169.003067:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 65 00000100:00100000:2.0:1788179169.003079:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+18:11269:x1875041451084672:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788179169.003716:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+19:11269:x1875041451084672:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 637us (819us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788179169.003726:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 65 00000100:00100000:3.0:1788179169.221562:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179169.221684:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451084800 00000100:00100000:0.0:1788179169.221696:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451084800 00000100:00100000:0.0:1788179169.221920:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 240 00000100:00100000:0.0:1788179169.221931:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fcf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:176e2bf4-b5b0-4c8a-ad1b-45962a669671+5:12076:x1875041451084800:12345-192.168.202.2@tcp:101:lsof.0 00010000:00010000:0.0:1788179169.221955:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179169.221979:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4999e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466233d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179169.222044:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4999ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179169.222057:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4999ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179169.222092:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4999ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179169.222380:0:5798:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788179169.222385:0:5798:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1788179169.222462:0:5798:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4999ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179169.222488:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f000/0xaa4c98508c4999e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466233d expref: 7 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179169.222505:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4999ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466233d expref: 6 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179169.222513:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc903312a00) 00010000:00010000:0.0:1788179169.222515:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788179169.222518:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317e200, rc 0) 00000100:00100000:0.0:1788179169.222572:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fcf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:176e2bf4-b5b0-4c8a-ad1b-45962a669671+6:12076:x1875041451084800:12345-192.168.202.2@tcp:101:lsof.0 Request processed in 643us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179169.222579:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 240 00000100:00080000:2.0:1788179169.225892:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788179169.416310:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179169.416353:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179169.416392:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179169.416587:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451085184 00000100:00100000:3.0:1788179169.416597:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451085184 00000100:00100000:3.0:1788179169.416666:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451085056 00000100:00100000:3.0:1788179169.416670:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451085056 00000100:00100000:3.0:1788179169.416696:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 99 00000100:00100000:3.0:1788179169.416707:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2356:x1875041451085184:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788179169.416787:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2356:x1875041451085184:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 82us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179169.416794:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 99 00000100:00100000:3.0:1788179169.416810:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 100 00000100:00100000:3.0:1788179169.416817:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2356:x1875041451085056:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788179169.416844:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2356:x1875041451085056:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 28us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179169.416884:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 100 00000100:00100000:0.0:1788179169.417416:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451084928 00000100:00100000:0.0:1788179169.417421:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451084928 00000100:00100000:0.0:1788179169.417469:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 301 00000100:00100000:0.0:1788179169.417477:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2356:x1875041451084928:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179169.417520:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2356:x1875041451084928:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 44us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179169.417527:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 301 00000100:00080000:1.0:1788179169.418177:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788179169.418182:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788179169.525403:0:12431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1788179169.525424:0:12431:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1788179169.525448:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788179169.525457:0:5830:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:1.0:1788179169.529021:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:1.0:1788179169.536212:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179170.560818:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179171.584707:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179172.035470:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788179172.035492:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472038272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788179172.035567:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179172.037572:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472038272 00000100:00100000:2.0:1788179172.037587:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472038272 00000100:00100000:2.0:1788179172.037658:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788179172.037668:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc901219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472038272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788179172.037706:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179172.037789:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc901219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472038272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (2221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179172.037797:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1788179172.044246:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788179172.044324:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1788179172.044333:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bc92e0f6680, transno 4294967324 00000100:00100000:0.0:1788179172.044366:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472038272:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788179172.607992:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788179172.818132:0:12724:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 08:26:10 (1788179170) 00000100:00100000:1.0:1788179173.058262:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93fcf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041472038400:0@lo:400:kworker.0 00000100:00100000:1.0:1788179173.058336:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179173.058393:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875041472038912:0@lo:400:kworker.0 00000100:00100000:1.0:1788179173.058420:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179173.058448:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788179173.058465:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041472038528:0@lo:400:kworker.0 00000100:00100000:1.0:1788179173.058490:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179173.058509:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472039040:0@lo:400:kworker.0 00000100:00100000:1.0:1788179173.058533:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179173.058571:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472038784:0@lo:400:kworker.0 00000100:00100000:1.0:1788179173.058708:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179173.058730:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788179173.058736:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875041472038656:0@lo:400:kworker.0 00000100:00100000:1.0:1788179173.058764:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179173.058792:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472038912 00000100:00100000:1.0:1788179173.058799:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472038912 00000100:00100000:1.0:1788179173.058869:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472038528 00000100:00100000:1.0:1788179173.058873:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472038528 00000100:00100000:1.0:1788179173.058892:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472038656 00000100:00100000:1.0:1788179173.058896:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472038656 00000100:00100000:1.0:1788179173.058912:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788179173.058920:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93539f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875041472038912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179173.058965:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472038400 00000100:00100000:3.0:1788179173.058969:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472038400 00000100:00100000:1.0:1788179173.058972:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93539f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875041472038912:12345-0@lo:400:kworker.0 Request processed in 53us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179173.058979:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788179173.058994:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788179173.058996:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788179173.059001:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+19:3305:x1875041472038400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179173.059001:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041472038528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179173.059034:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efc6f743-3303-46d5-8807-513b82cac1cc+19:3305:x1875041472038400:12345-0@lo:400:kworker.0 Request processed in 32us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179173.059035:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041472038528:12345-0@lo:400:kworker.0 Request processed in 36us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179173.059040:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788179173.059041:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788179173.059051:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788179173.059056:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875041472038656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179173.059082:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875041472038656:12345-0@lo:400:kworker.0 Request processed in 26us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179173.059088:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788179173.059104:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875041472038656:0@lo:400:kworker.0 00000100:00100000:1.0:1788179173.059107:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472039040 00000100:00100000:1.0:1788179173.059109:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472039040 00000100:00100000:1.0:1788179173.059132:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472038784 00000100:00100000:1.0:1788179173.059136:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472038784 00000100:00100000:1.0:1788179173.059169:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788179173.059175:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472039040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179173.059207:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472039040:12345-0@lo:400:kworker.0 Request processed in 32us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179173.059213:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788179173.059223:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788179173.059229:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472038784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179173.059259:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472038784:12345-0@lo:400:kworker.0 Request processed in 31us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179173.059265:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1788179173.059285:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788179173.059289:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788179173.059313:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472038784:0@lo:400:kworker.0 00000100:00100000:1.0:1788179173.059333:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041472038528:0@lo:400:kworker.0 00000100:00100000:1.0:1788179173.059349:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472039040:0@lo:400:kworker.0 00000100:00100000:1.0:1788179173.059357:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93fcf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041472038400:0@lo:400:kworker.0 00000100:00100000:1.0:1788179173.059364:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875041472038912:0@lo:400:kworker.0 00000100:00100000:3.0:1788179173.571626:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788179173.571653:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472039168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788179173.571721:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179173.571780:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472039168 00000100:00100000:3.0:1788179173.571787:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472039168 00000100:00100000:3.0:1788179173.571833:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788179173.571841:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b612d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472039168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788179173.571908:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788179173.571954:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b612d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472039168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179173.571962:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788179173.572009:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472039168:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788179173.639361:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179174.546183:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179174.546228:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179174.546258:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179174.546291:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179174.546313:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179174.546339:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451085696 00000100:00100000:1.0:1788179174.546347:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451085696 00000100:00100000:1.0:1788179174.546397:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451085568 00000100:00100000:1.0:1788179174.546400:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451085568 00000100:00100000:1.0:1788179174.546423:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 103 00000100:00100000:1.0:1788179174.546432:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fcf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2355:x1875041451085696:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179174.546498:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fcf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2355:x1875041451085696:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 67us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179174.546506:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 103 00000100:00100000:1.0:1788179174.546543:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 104 00000100:00100000:1.0:1788179174.546550:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2355:x1875041451085568:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179174.546577:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2355:x1875041451085568:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 27us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179174.546583:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 104 00000100:00100000:1.0:1788179174.546602:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451085312 00000100:00100000:1.0:1788179174.546606:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451085312 00000100:00100000:1.0:1788179174.546642:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 303 00000100:00100000:1.0:1788179174.546648:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2355:x1875041451085312:12345-192.168.202.2@tcp:400:kworker.0 00000100:00080000:3.0:1788179174.546687:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788179174.546692:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788179174.546713:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451085440 00000100:00100000:3.0:1788179174.546716:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451085440 00000100:00100000:3.0:1788179174.546749:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451085824 00000100:00100000:3.0:1788179174.546759:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451085824 00000100:00100000:3.0:1788179174.546783:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 166 00000100:00100000:3.0:1788179174.546789:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93abbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+18:2355:x1875041451085440:12345-192.168.202.2@tcp:400:kworker.0 00000100:00080000:2.0:1788179174.546895:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788179174.546917:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 167 00000100:00100000:2.0:1788179174.546933:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:176e2bf4-b5b0-4c8a-ad1b-45962a669671+6:2355:x1875041451085824:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179174.547036:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2355:x1875041451085312:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 387us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179174.547043:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 303 00000100:00100000:3.0:1788179174.547234:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93abbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+18:2355:x1875041451085440:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 443us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179174.547252:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 166 00000100:00100000:2.0:1788179174.547832:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:176e2bf4-b5b0-4c8a-ad1b-45962a669671+6:2355:x1875041451085824:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 900us (1515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179174.547839:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 167 00010000:00010000:3.0:1788179174.664650:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179175.686702:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179176.704203:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788179176.768096:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788179176.768104:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788179176.768879:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788179176.768887:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788179177.145961:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179177.146106:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451086080 00000100:00100000:3.0:1788179177.146117:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451086080 00000100:00100000:3.0:1788179177.146194:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 66 00000100:00100000:3.0:1788179177.146207:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+18:12298:x1875041451086080:12345-192.168.202.2@tcp:35:umount.0 00000100:00100000:3.0:1788179177.147393:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+19:12298:x1875041451086080:12345-192.168.202.2@tcp:35:umount.0 Request processed in 1184us (1437us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788179177.147403:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 66 00000100:00080000:2.0:1788179177.147529:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788179177.152250:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788179177.152274:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc934bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472039296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788179177.152341:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179177.152516:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472039296 00000100:00100000:2.0:1788179177.152524:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472039296 00000100:00100000:2.0:1788179177.152602:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788179177.152612:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90121ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472039296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788179177.152645:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179177.152701:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90121ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472039296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179177.152707:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1788179177.153876:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788179177.153926:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc934bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472039296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788179177.155738:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179177.155871:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451086336 00000100:00100000:0.0:1788179177.155880:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451086336 00000100:00100000:0.0:1788179177.155929:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 67 00000100:00100000:0.0:1788179177.155938:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+19:12298:x1875041451086336:12345-192.168.202.2@tcp:35:umount.0 00000100:00100000:0.0:1788179177.156275:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+20:12298:x1875041451086336:12345-192.168.202.2@tcp:35:umount.0 Request processed in 336us (543us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788179177.156282:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 67 00000100:00100000:1.0:1788179177.159882:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179177.160344:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451086592 00000100:00100000:2.0:1788179177.160353:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451086592 00000100:00100000:2.0:1788179177.160423:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 68 00000100:00100000:2.0:1788179177.160433:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9071edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+20:12298:x1875041451086592:12345-192.168.202.2@tcp:35:umount.0 00000100:00100000:2.0:1788179177.161445:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9071edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:334bb25c-6762-4beb-8a84-3a838cbc7e80+21:12298:x1875041451086592:12345-192.168.202.2@tcp:35:umount.0 Request processed in 1010us (1593us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788179177.161455:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 68 00000100:00100000:1.0:1788179177.177459:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179177.177537:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451086848 00000100:00100000:3.0:1788179177.177547:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451086848 00000100:00100000:3.0:1788179177.177613:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 69 00000100:00100000:3.0:1788179177.177623:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+21:12298:x1875041451086848:12345-192.168.202.2@tcp:35:umount.0 00000100:00100000:3.0:1788179177.177999:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334bb25c-6762-4beb-8a84-3a838cbc7e80+22:12298:x1875041451086848:12345-192.168.202.2@tcp:35:umount.0 Request processed in 377us (549us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788179177.178007:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 69 00000100:00100000:1.0:1788179177.180939:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179177.181096:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451086976 00000100:00100000:2.0:1788179177.181118:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451086976 00000100:00100000:2.0:1788179177.181183:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:2.0:1788179177.181193:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc906224e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2357:x1875041451086976:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788179177.181208:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179177.181228:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc9136c4e00/0xaa4c98508c4989fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ec1 expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179177.181243:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788179177.181291:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc906224e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+12:2357:x1875041451086976:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 100us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179177.181299:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:1.0:1788179177.192449:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179177.192496:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179177.192538:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179177.192677:0:7778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451087104 00000100:00100000:2.0:1788179177.192687:0:7778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451087104 00000100:00100000:2.0:1788179177.192750:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 72 00000100:00100000:2.0:1788179177.192760:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2353:x1875041451087104:12345-192.168.202.2@tcp:9:umount.0 00000020:00000080:2.0:1788179177.192789:0:7778:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c498d35 00000100:00080000:2.0:1788179177.192798:0:7778:0:(import.c:65:import_set_state_nolock()) ffff9bc93ab5e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788179177.192844:0:7778:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788179177.193118:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334bb25c-6762-4beb-8a84-3a838cbc7e80+2:2353:x1875041451087104:12345-192.168.202.2@tcp:9:umount.0 Request processed in 359us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179177.193127:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 72 00000100:00100000:0.0:1788179177.193380:0:11517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451087360 00000100:00100000:0.0:1788179177.193386:0:11517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451087360 00000100:00100000:0.0:1788179177.193428:0:11517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451087232 00000100:00100000:0.0:1788179177.193432:0:11517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451087232 00000100:00100000:0.0:1788179177.193466:0:11517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:0.0:1788179177.193474:0:11517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+13:2354:x1875041451087360:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179177.193512:0:11517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179177.193532:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc92e12c600/0xaa4c98508c498c47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f8c expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179177.193549:0:11517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179177.193588:0:11517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+12:2354:x1875041451087360:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 105us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179177.193595:0:11517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:0.0:1788179177.193613:0:11517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:0.0:1788179177.193620:0:11517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+11:2354:x1875041451087232:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179177.193627:0:11517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179177.193636:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc9136c4400/0xaa4c98508c4989c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661e89 expref: 11 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179177.193646:0:11517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179177.193663:0:11517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:2354:x1875041451087232:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 44us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179177.193669:0:11517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00010000:00010000:0.0:1788179177.193685:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788179177.194366:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788179177.205053:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179177.205517:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451087744 00000100:00100000:2.0:1788179177.205528:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451087744 00000100:00100000:2.0:1788179177.205611:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 73 00000100:00100000:2.0:1788179177.205621:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b5a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+7:2353:x1875041451087744:12345-192.168.202.2@tcp:9:umount.0 00000020:00000080:2.0:1788179177.205653:0:6591:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c498f9d 00000020:00010000:2.0:1788179177.205659:0:6591:0:(genops.c:1950:obd_stale_export_put()) Put export ffff9bc926724800: total 0 00000100:00080000:2.0:1788179177.205676:0:6591:0:(import.c:65:import_set_state_nolock()) ffff9bc926727000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788179177.205723:0:6591:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788179177.206004:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b5a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334bb25c-6762-4beb-8a84-3a838cbc7e80+5:2353:x1875041451087744:12345-192.168.202.2@tcp:9:umount.0 Request processed in 383us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179177.206012:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 73 00000020:00010000:0.0:1788179177.206295:0:6606:0:(genops.c:1936:obd_stale_export_get()) Get export ffff9bc926724800: total 0 00010000:00010000:0.0:1788179177.206327:0:6606:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9bc926724800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788179177.206378:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ae5f542/0xaa4c98508c499339 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662161 expref: 4 pid: 6591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179177.206427:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff411512/0xaa4c98508c4999de lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662336 expref: 3 pid: 7778 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179177.206458:0:6606:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9bc926724800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788179177.206470:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179177.206472:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179177.206474:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788179177.206887:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788179177.239226:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179177.239318:0:12275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451088768 00000100:00100000:1.0:1788179177.239328:0:12275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451088768 00000100:00100000:1.0:1788179177.239384:0:12275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 241 00000100:00100000:1.0:1788179177.239394:0:12275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90121a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+22:2353:x1875041451088768:12345-192.168.202.2@tcp:39:umount.0 00000020:00000080:1.0:1788179177.239442:0:12275:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c4989d1 00000020:00010000:1.0:1788179177.239461:0:12275:0:(genops.c:1950:obd_stale_export_put()) Put export ffff9bc93b623800: total 0 00000100:00080000:1.0:1788179177.239466:0:12275:0:(import.c:65:import_set_state_nolock()) ffff9bc93b627800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788179177.239500:0:12275:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:1.0:1788179177.239918:0:12275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90121a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:334bb25c-6762-4beb-8a84-3a838cbc7e80+21:2353:x1875041451088768:12345-192.168.202.2@tcp:39:umount.0 Request processed in 524us (699us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788179177.239926:0:12275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 241 00000020:00010000:2.0:1788179177.240520:0:6605:0:(genops.c:1936:obd_stale_export_get()) Get export ffff9bc93b623800: total 0 00010000:00010000:2.0:1788179177.240564:0:6605:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9bc93b623800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788179177.240611:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:2.0:1788179177.240615:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788179177.240622:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942173c00/0xaa4c98508c4993b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662184 expref: 20 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179177.240640:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:2.0:1788179177.240643:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788179177.240647:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d600/0xaa4c98508c49921a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662114 expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179177.240659:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:2.0:1788179177.240661:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788179177.240665:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c4200/0xaa4c98508c498d0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fb6 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179177.240677:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:2.0:1788179177.240680:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788179177.240683:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5a00/0xaa4c98508c49999f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662321 expref: 17 pid: 12275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179177.240694:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:2.0:1788179177.240704:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788179177.240708:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9136c5000/0xaa4c98508c4999c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466232f expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179177.240722:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bc903340c00) 00010000:00010000:2.0:1788179177.240725:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179177.240728:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92e12d800/0xaa4c98508c498cb7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661fa1 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179177.240744:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc903312a00) 00010000:00010000:2.0:1788179177.240747:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788179177.240750:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4e00/0xaa4c98508c49939b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466217d expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179177.240761:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9bc902d54d00) 00010000:00010000:2.0:1788179177.240763:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788179177.240767:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c4998bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746622e9 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179177.240782:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:2.0:1788179177.240785:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788179177.240788:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fc00/0xaa4c98508c4992fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466214c expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179177.240797:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9bc920ca7f00) 00010000:00010000:2.0:1788179177.240799:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788179177.240803:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc942172200/0xaa4c98508c49969d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466225d expref: 11 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179177.240845:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9bc9062cb600) 00010000:00010000:2.0:1788179177.240888:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788179177.240893:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4400/0xaa4c98508c499324 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466215a expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179177.240909:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9bc909481100) 00010000:00010000:2.0:1788179177.240911:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788179177.240914:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e400/0xaa4c98508c498ff8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662088 expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179177.240936:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bc903312700) 00010000:00010000:2.0:1788179177.240939:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788179177.240943:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc901499200/0xaa4c98508c498c9b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f9a expref: 8 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179177.240958:0:6605:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9bc93b623800, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1788179177.240971:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179177.240973:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179177.240975:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179177.727997:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179178.177868:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472039808:0@lo:400:kworker.0 00000100:00100000:3.0:1788179178.177937:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179178.178000:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788179178.178006:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875041472039680:0@lo:400:kworker.0 00000100:00100000:3.0:1788179178.178045:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179178.178082:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472039680 00000100:00100000:3.0:1788179178.178089:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472039680 00000100:00100000:3.0:1788179178.178145:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788179178.178155:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875041472039680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179178.178171:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875041472039552:0@lo:400:kworker.0 00000100:00100000:0.0:1788179178.178199:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179178.178207:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875041472039680:12345-0@lo:400:kworker.0 Request processed in 55us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179178.178214:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788179178.178214:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472040064:0@lo:400:kworker.0 00000100:00100000:3.0:1788179178.178229:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472039552 00000100:00100000:3.0:1788179178.178232:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472039552 00000100:00100000:0.0:1788179178.178232:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179178.178249:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788179178.178250:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788179178.178254:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041472039424:0@lo:400:kworker.0 00000100:00100000:3.0:1788179178.178256:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc901219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875041472039552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179178.178279:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179178.178281:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc901219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875041472039552:12345-0@lo:400:kworker.0 Request processed in 26us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179178.178287:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788179178.178299:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875041472039936:0@lo:400:kworker.0 00000100:00100000:3.0:1788179178.178307:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472039424 00000100:00100000:3.0:1788179178.178310:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472039424 00000100:00100000:0.0:1788179178.178319:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179178.178329:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788179178.178335:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:3306:x1875041472039424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179178.178349:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875041472039552:0@lo:400:kworker.0 00000100:00100000:3.0:1788179178.178359:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+19:3306:x1875041472039424:12345-0@lo:400:kworker.0 Request processed in 25us (79us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179178.178364:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788179178.178386:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041472039424:0@lo:400:kworker.0 00000100:00100000:3.0:1788179178.178391:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472039808 00000100:00100000:3.0:1788179178.178394:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472039808 00000100:00100000:3.0:1788179178.178417:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472040064 00000100:00100000:3.0:1788179178.178419:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472040064 00000100:00080000:0.0:1788179178.178435:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788179178.178438:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1788179178.178439:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788179178.178444:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472039808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179178.178450:0:7778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788179178.178457:0:7778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90121b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472040064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179178.178481:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472039808:12345-0@lo:400:kworker.0 Request processed in 37us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179178.178487:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788179178.178505:0:7778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90121b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472040064:12345-0@lo:400:kworker.0 Request processed in 40us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179178.178511:0:7778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788179178.178518:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472039936 00000100:00100000:3.0:1788179178.178520:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472039936 00000100:00100000:0.0:1788179178.178542:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472040064:0@lo:400:kworker.0 00000100:00100000:3.0:1788179178.178544:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788179178.178549:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90121b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875041472039936:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788179178.178569:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788179178.178593:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90121b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875041472039936:12345-0@lo:400:kworker.0 Request processed in 44us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179178.178593:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875041472039680:0@lo:400:kworker.0 00000100:00100000:3.0:1788179178.178599:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788179178.178615:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472039808:0@lo:400:kworker.0 00000100:00100000:3.0:1788179178.178621:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875041472039936:0@lo:400:kworker.0 00000100:00100000:0.0:1788179178.688191:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472040192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788179178.688273:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179178.688983:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472040192 00000100:00100000:2.0:1788179178.688993:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472040192 00000100:00100000:2.0:1788179178.689064:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788179178.689077:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472040192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788179178.689118:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179178.689197:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472040192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179178.689219:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788179178.689586:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472040192:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788179178.754292:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788179179.397128:0:7496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 334bb25c-6762-4beb-8a84-3a838cbc7e80 00000020:00000080:2.0:1788179179.397137:0:7496:0:(genops.c:907:class_export_put()) final put ffff9bc93ab5b000/334bb25c-6762-4beb-8a84-3a838cbc7e80 00000020:00000080:0.0:1788179179.397227:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc93ab5b000/334bb25c-6762-4beb-8a84-3a838cbc7e80 for lustre-OST0001 00000020:00000080:0.0:1788179179.397281:0:36:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9bc93ab5e000 for lustre-OST0001 00000100:00100000:2.0:1788179179.656700:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179179.656749:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179179.656951:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451088896 00000100:00100000:0.0:1788179179.656961:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451088896 00000100:00100000:0.0:1788179179.657026:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 305 00000100:00100000:0.0:1788179179.657035:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:2356:x1875041451088896:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179179.657109:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:2356:x1875041451088896:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 75us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179179.657118:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 305 00000100:00100000:3.0:1788179179.657196:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451089024 00000100:00100000:3.0:1788179179.657201:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451089024 00000100:00100000:3.0:1788179179.657253:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 171 00000100:00100000:3.0:1788179179.657262:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:176e2bf4-b5b0-4c8a-ad1b-45962a669671+6:2356:x1875041451089024:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788179179.657296:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:176e2bf4-b5b0-4c8a-ad1b-45962a669671+6:2356:x1875041451089024:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 36us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179179.657302:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 171 00000100:00080000:0.0:1788179179.657418:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788179179.778027:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788179179.793099:0:12431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000001:00100000:0.0:1788179179.793216:0:5818:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 334bb25c-6762-4beb-8a84-3a838cbc7e80 00000001:00080000:0.0:1788179179.793223:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1788179179.793251:0:5818:0:(genops.c:907:class_export_put()) final put ffff9bc93b623800/334bb25c-6762-4beb-8a84-3a838cbc7e80 00000020:00000080:0.0:1788179179.793271:0:471:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc93b623800/334bb25c-6762-4beb-8a84-3a838cbc7e80 for lustre-MDT0000 00000020:00000080:0.0:1788179179.793324:0:471:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9bc93b627800 for lustre-MDT0000 00000001:00100000:3.0:1788179179.799318:0:6618:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 334bb25c-6762-4beb-8a84-3a838cbc7e80 00000020:00000080:3.0:1788179179.799327:0:6618:0:(genops.c:907:class_export_put()) final put ffff9bc926724800/334bb25c-6762-4beb-8a84-3a838cbc7e80 00000020:00000080:1.0:1788179179.799413:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc926724800/334bb25c-6762-4beb-8a84-3a838cbc7e80 for lustre-OST0000 00000020:00000080:1.0:1788179179.799459:0:36:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9bc926727000 for lustre-OST0000 00000100:00100000:0.0:1788179180.733441:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179180.733510:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179180.733550:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179180.733598:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451089152 00000100:00100000:1.0:1788179180.733618:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451089152 00000100:00100000:3.0:1788179180.733623:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451089408 00000100:00100000:3.0:1788179180.733626:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451089408 00000100:00100000:1.0:1788179180.733680:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451089280 00000100:00100000:1.0:1788179180.733684:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451089280 00000100:00100000:3.0:1788179180.743453:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:3.0:1788179180.743489:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+12:2356:x1875041451089152:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788179180.743510:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179180.743546:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc9136c5c00/0xaa4c98508c498aa3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ed6 expref: 12 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179180.743565:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179180.743632:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+11:2356:x1875041451089152:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 166us (10211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179180.744757:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:3.0:1788179180.744793:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:3.0:1788179180.744805:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b611500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+10:2356:x1875041451089408:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788179180.744819:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179180.744834:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc9136c5400/0xaa4c98508c498c40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f85 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179180.744847:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179180.744898:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b611500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+9:2356:x1875041451089408:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 97us (11387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179180.744905:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:3.0:1788179180.744920:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:3.0:1788179180.744927:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b612680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+8:2356:x1875041451089280:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788179180.744935:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179180.745037:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc9137b4a00/0xaa4c98508c498aaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661f00 expref: 8 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179180.745048:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179180.745067:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b612680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+7:2356:x1875041451089280:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 141us (11516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179180.745073:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:2.0:1788179180.756264:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179180.756333:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451089664 00000100:00100000:3.0:1788179180.756342:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451089664 00000100:00100000:3.0:1788179180.756410:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 242 00000100:00100000:3.0:1788179180.756419:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc934bfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:176e2bf4-b5b0-4c8a-ad1b-45962a669671+6:2353:x1875041451089664:12345-192.168.202.2@tcp:39:umount.0 00000020:00000080:3.0:1788179180.756478:0:5797:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c498ab8 00000020:00010000:3.0:1788179180.756487:0:5797:0:(genops.c:1950:obd_stale_export_put()) Put export ffff9bc93f938800: total 0 00000100:00080000:3.0:1788179180.756491:0:5797:0:(import.c:65:import_set_state_nolock()) ffff9bc93f939800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788179180.756515:0:5797:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:2.0:1788179180.757544:0:6605:0:(genops.c:1936:obd_stale_export_get()) Get export ffff9bc93f938800: total 0 00010000:00010000:2.0:1788179180.757594:0:6605:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9bc93f938800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788179180.757702:0:6605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc903312a00) 00010000:00010000:2.0:1788179180.757706:0:6605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788179180.757716:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e200/0xaa4c98508c4999ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466233d expref: 7 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179180.757738:0:6605:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9bc93f938800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788179180.757749:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179180.757751:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179180.757752:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179180.758156:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc934bfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:176e2bf4-b5b0-4c8a-ad1b-45962a669671+3:2353:x1875041451089664:12345-192.168.202.2@tcp:39:umount.0 Request processed in 1736us (1899us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788179180.758166:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 242 00010000:00010000:2.0:1788179180.800182:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179180.809462:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179180.809622:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451089920 00000100:00100000:3.0:1788179180.809633:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451089920 00000100:00100000:3.0:1788179180.809699:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 306 00000100:00100000:3.0:1788179180.809710:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+7:2353:x1875041451089920:12345-192.168.202.2@tcp:251:umount.0 00000020:00000080:3.0:1788179180.809758:0:5789:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c4989ae 00000020:00010000:3.0:1788179180.809766:0:5789:0:(genops.c:1950:obd_stale_export_put()) Put export ffff9bc9267f4800: total 0 00000100:00080000:3.0:1788179180.809772:0:5789:0:(import.c:65:import_set_state_nolock()) ffff9bc9267f7000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788179180.809877:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:acb73c7e-aaaf-4666-a05e-a4b9911fcad0+3:2353:x1875041451089920:12345-192.168.202.2@tcp:251:umount.0 Request processed in 143us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179180.809885:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 306 00000020:00010000:1.0:1788179180.810110:0:5784:0:(genops.c:1936:obd_stale_export_get()) Get export ffff9bc9267f4800: total 0 00010000:00010000:1.0:1788179180.810114:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179180.810153:0:5784:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9bc9267f4800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788179180.810184:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc92e12d400/0xaa4c98508c498a02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474661ec8 expref: 2 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179180.810198:0:5784:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9bc9267f4800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788179180.810218:0:5784:0:(genops.c:907:class_export_put()) final put ffff9bc9267f4800/acb73c7e-aaaf-4666-a05e-a4b9911fcad0 00010000:00010000:1.0:1788179180.810236:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179180.810238:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179180.810240:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788179180.810554:0:471:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc9267f4800/acb73c7e-aaaf-4666-a05e-a4b9911fcad0 for MGS 00000020:00000080:3.0:1788179180.819108:0:471:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9bc9267f7000 for MGS 00010000:00010000:2.0:1788179181.834203:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179182.274900:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788179182.274922:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472040320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788179182.274989:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179182.275060:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472040320 00000100:00100000:0.0:1788179182.275067:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472040320 00000100:00100000:0.0:1788179182.275123:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788179182.275131:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e6bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472040320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788179182.275163:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788179182.275196:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e6bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472040320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179182.275201:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1788179182.275219:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788179182.275244:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472040320:0@lo:13:osp-pre-0-0.0 00000020:01000004:1.0:1788179182.814136:0:12925:0:(tgt_mount.c:2269:server_umount_begin()) umount -f 00010000:00010000:2.0:1788179182.848342:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788179182.858191:0:12925:0:(tgt_mount.c:2129:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788179182.858249:0:12925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5800/0xaa4c98508c498a41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a48 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179182.858264:0:12925:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5800/0xaa4c98508c498a41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498a48 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179182.858272:0:12925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5800/0xaa4c98508c498a41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa4c98508c498a48 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179182.858279:0:12925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5800/0xaa4c98508c498a41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa4c98508c498a48 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179182.858325:0:12925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788179182.858330:0:12925:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788179182.858356:0:12925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788179182.858430:0:12925:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788179182.858437:0:12925:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788179182.858492:0:12925:0:(import.c:65:import_set_state_nolock()) ffff9bc926643800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788179182.858633:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875041472040448:0@lo:39:umount.0 00000100:00100000:0.0:1788179182.858699:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179182.859111:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472040448 00000100:00100000:1.0:1788179182.859119:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472040448 00000100:00100000:1.0:1788179182.859164:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788179182.859172:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e6bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875041472040448:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788179182.859198:0:5796:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c4987bd 00000100:00080000:1.0:1788179182.859205:0:5796:0:(import.c:65:import_set_state_nolock()) ffff9bc9137e7000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788179182.859262:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e6bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3304:x1875041472040448:12345-0@lo:39:umount.0 Request processed in 89us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179182.859269:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000020:00000080:1.0:1788179182.859277:0:5796:0:(genops.c:907:class_export_put()) final put ffff9bc9137e4000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1788179182.859345:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788179182.859351:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5800/0xaa4c98508c498a41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa4c98508c498a48 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179182.859358:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5800 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:2.0:1788179182.859376:0:5785:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5800/0xaa4c98508c498a41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa4c98508c498a48 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179182.859384:0:5785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5800/0xaa4c98508c498a41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa4c98508c498a48 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788179182.859399:0:5785:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5800/0xaa4c98508c498a41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa4c98508c498a48 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788179182.859404:0:5785:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788179182.859406:0:5785:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788179182.859408:0:5785:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788179182.859433:0:5785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5800/0xaa4c98508c498a41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa4c98508c498a48 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179182.859439:0:5785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788179182.859465:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5800/0xaa4c98508c498a41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa4c98508c498a48 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179182.859472:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5800/0xaa4c98508c498a41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa4c98508c498a48 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179182.859484:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179182.859486:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179182.859488:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788179182.859549:0:471:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc9137e4000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00010000:00010000:0.0:1788179182.859670:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788179182.859699:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9bc926643800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788179182.859708:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875041472040448:0@lo:39:umount.0 00000100:00100000:1.0:1788179182.859821:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc907038e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041472040576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788179182.859895:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788179182.859933:0:12925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788179182.859936:0:12925:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788179182.859940:0:12925:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788179182.860995:0:12925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900030c00/0xaa4c98508c498a4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a56 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179182.861010:0:12925:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900030c00/0xaa4c98508c498a4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498a56 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179182.861030:0:12925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900030c00/0xaa4c98508c498a4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa4c98508c498a56 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179182.861036:0:12925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff9bc900030c00/0xaa4c98508c498a4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa4c98508c498a56 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179182.861054:0:12925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788179182.861059:0:12925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317e000/0xaa4c98508c498968 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c49896f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179182.861066:0:12925:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317e000/0xaa4c98508c498968 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c49896f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179182.861072:0:12925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317e000/0xaa4c98508c498968 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa4c98508c49896f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179182.861078:0:12925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff9bc91317e000/0xaa4c98508c498968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa4c98508c49896f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179182.861092:0:12925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788179182.861104:0:6605:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788179182.861109:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc900030c00/0xaa4c98508c498a4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa4c98508c498a56 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179182.861117:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc900030c00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:1.0:1788179182.861120:0:6605:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc900030c00/0xaa4c98508c498a4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa4c98508c498a56 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179182.861128:0:6605:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc900030c00/0xaa4c98508c498a4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa4c98508c498a56 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788179182.861141:0:6605:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc900030c00/0xaa4c98508c498a4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa4c98508c498a56 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788179182.861147:0:6605:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788179182.861149:0:6605:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788179182.861171:0:6605:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc900030c00/0xaa4c98508c498a4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa4c98508c498a56 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179182.861178:0:6605:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788179182.861192:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc900030c00/0xaa4c98508c498a4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa4c98508c498a56 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179182.861200:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc900030c00/0xaa4c98508c498a4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa4c98508c498a56 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179182.861211:0:6605:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788179182.861214:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc91317e000/0xaa4c98508c498968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa4c98508c49896f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179182.861219:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317e000 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:1.0:1788179182.861221:0:6605:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc91317e000/0xaa4c98508c498968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa4c98508c49896f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179182.861227:0:6605:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc91317e000/0xaa4c98508c498968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa4c98508c49896f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788179182.861233:0:6605:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc91317e000/0xaa4c98508c498968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa4c98508c49896f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788179182.861238:0:6605:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788179182.861246:0:6605:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788179182.861248:0:6605:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788179182.861262:0:6605:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc91317e000/0xaa4c98508c498968 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa4c98508c49896f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179182.861268:0:6605:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788179182.861281:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc91317e000/0xaa4c98508c498968 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa4c98508c49896f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179182.861288:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc91317e000/0xaa4c98508c498968 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa4c98508c49896f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179182.861301:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179182.861302:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179182.861304:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179182.861315:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788179182.861327:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041472040704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788179182.861370:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179182.861409:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788179182.861417:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041472040832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788179182.861440:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179182.861480:0:11517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472040576 00000100:00100000:1.0:1788179182.861486:0:11517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472040576 00000100:00100000:1.0:1788179182.861519:0:11517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472040704 00000100:00100000:1.0:1788179182.861523:0:11517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472040704 00000100:00100000:1.0:1788179182.861535:0:11517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472040832 00000100:00100000:1.0:1788179182.861538:0:11517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472040832 00000100:00100000:1.0:1788179182.861550:0:11517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788179182.861557:0:11517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90710e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efc6f743-3303-46d5-8807-513b82cac1cc+21:3305:x1875041472040576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788179182.861569:0:11517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788179182.861818:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788179182.861827:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803603b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efc6f743-3303-46d5-8807-513b82cac1cc+21:3305:x1875041472040704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788179182.861835:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788179182.862160:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc9137b5c00/0xaa4c98508c498a48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa4c98508c498a41 expref: 21 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179182.863078:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788179182.863224:0:471:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9bc9137e7000 for lustre-MDT0000 00010000:00010000:0.0:1788179182.863353:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc92e12da00/0xaa4c98508c498a56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa4c98508c498a4f expref: 20 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179182.863386:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179182.863467:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803603b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efc6f743-3303-46d5-8807-513b82cac1cc+19:3305:x1875041472040704:12345-0@lo:103:ldlm_bl.0 Request processed in 1640us (2095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179182.863475:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788179182.863501:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788179182.863510:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803603800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efc6f743-3303-46d5-8807-513b82cac1cc+18:3308:x1875041472040832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788179182.863521:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179182.863530:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc91317f800/0xaa4c98508c49896f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa4c98508c498968 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179182.863543:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179182.863591:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803603800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efc6f743-3303-46d5-8807-513b82cac1cc+17:3308:x1875041472040832:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (2139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179182.863597:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788179182.863747:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efc6f743-3303-46d5-8807-513b82cac1cc:3308:1875041472040832:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788179182.863799:0:12925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4c00/0xaa4c98508c498c6a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498c71 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179182.863817:0:12925:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4c00/0xaa4c98508c498c6a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498c71 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179182.863824:0:12925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4c00/0xaa4c98508c498c6a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa4c98508c498c71 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179182.863830:0:12925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4c00/0xaa4c98508c498c6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa4c98508c498c71 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179182.864124:0:12925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788179182.864448:0:12925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317e600/0xaa4c98508c49871c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498723 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179182.864466:0:12925:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317e600/0xaa4c98508c49871c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498723 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179182.864473:0:12925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317e600/0xaa4c98508c49871c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa4c98508c498723 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179182.864479:0:12925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff9bc91317e600/0xaa4c98508c49871c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa4c98508c498723 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179182.864492:0:12925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788179182.864495:0:12925:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788179182.864509:0:12925:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788179182.864549:0:12925:0:(tgt_mount.c:2189:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788179182.864552:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788179182.864556:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788179182.864561:0:12925:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:3.0:1788179182.864570:0:12925:0:(genops.c:1848:print_export_data()) lustre-MDT0000: ACTIVE ffff9bc934be1800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788179182.864576:0:12925:0:(genops.c:1848:print_export_data()) lustre-MDT0000: ACTIVE ffff9bc93abd5000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788179182.864645:0:12925:0:(genops.c:1848:print_export_data()) lustre-MDT0000: UNLINKED ffff9bc93f938800 176e2bf4-b5b0-4c8a-ad1b-45962a669671 192.168.202.2@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788179182.864651:0:12925:0:(genops.c:1582:class_disconnect_exports()) OBD device 5 (ffff9bc93abc0000) has exports, disconnecting them 00000020:00080000:3.0:1788179182.864654:0:12925:0:(genops.c:1557:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bc934be1800), last request at 1788179178 00000020:00000080:3.0:1788179182.864661:0:12925:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c498930 00000100:00080000:3.0:1788179182.864673:0:12925:0:(import.c:65:import_set_state_nolock()) ffff9bc934be6000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788179182.864711:0:12925:0:(genops.c:1562:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bc934be1800): rc 0 00000020:00000080:3.0:1788179182.864714:0:12925:0:(genops.c:907:class_export_put()) final put ffff9bc934be1800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788179182.864721:0:12925:0:(genops.c:1557:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9bc93abd5000), last request at 1788179178 00000020:00000080:3.0:1788179182.864725:0:12925:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c498865 00000100:00080000:3.0:1788179182.864730:0:12925:0:(import.c:65:import_set_state_nolock()) ffff9bc93abd0800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788179182.864742:0:471:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc934be1800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788179182.864773:0:471:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9bc934be6000 for lustre-MDT0000 00000020:00080000:3.0:1788179182.864980:0:12925:0:(genops.c:1562:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bc93abd5000): rc 0 00000020:00000080:3.0:1788179182.864982:0:12925:0:(genops.c:907:class_export_put()) final put ffff9bc93abd5000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1788179182.864992:0:12925:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb4e2039ffae0 00000020:00000080:3.0:1788179182.865001:0:471:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc93abd5000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788179182.865026:0:471:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9bc93abd0800 for lustre-MDT0000 00000100:00080000:3.0:1788179182.865044:0:12925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788179182.865047:0:12925:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1788179182.865057:0:12925:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788179182.865112:0:12925:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788179182.865130:0:12925:0:(import.c:65:import_set_state_nolock()) ffff9bc902f15000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788179182.865142:0:12925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788179182.865144:0:12925:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1788179182.865151:0:12925:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788179182.865222:0:12925:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788179182.865230:0:12925:0:(import.c:65:import_set_state_nolock()) ffff9bc8019ef800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788179182.865255:0:12925:0:(genops.c:1587:class_disconnect_exports()) OBD device 5 (ffff9bc93abc0000) has no exports 00010000:00010000:3.0:1788179182.865486:0:6605:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788179182.865494:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4c00/0xaa4c98508c498c6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa4c98508c498c71 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179182.865503:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c4c00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:3.0:1788179182.865507:0:6605:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4c00/0xaa4c98508c498c6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa4c98508c498c71 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179182.865515:0:6605:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4c00/0xaa4c98508c498c6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa4c98508c498c71 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788179182.865521:0:6605:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4c00/0xaa4c98508c498c6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa4c98508c498c71 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788179182.865526:0:6605:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788179182.865529:0:6605:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788179182.865531:0:6605:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788179182.865558:0:6605:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4c00/0xaa4c98508c498c6a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa4c98508c498c71 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179182.865565:0:6605:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788179182.865580:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4c00/0xaa4c98508c498c6a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa4c98508c498c71 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179182.866000:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4c00/0xaa4c98508c498c6a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa4c98508c498c71 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179182.866012:0:6605:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788179182.866022:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc91317e600/0xaa4c98508c49871c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa4c98508c498723 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179182.866028:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317e600 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:3.0:1788179182.866031:0:6605:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc91317e600/0xaa4c98508c49871c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa4c98508c498723 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179182.866037:0:6605:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc91317e600/0xaa4c98508c49871c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa4c98508c498723 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788179182.866044:0:6605:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc91317e600/0xaa4c98508c49871c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa4c98508c498723 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788179182.866049:0:6605:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788179182.866051:0:6605:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788179182.866053:0:6605:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788179182.866081:0:6605:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc91317e600/0xaa4c98508c49871c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa4c98508c498723 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179182.866088:0:6605:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788179182.866101:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc91317e600/0xaa4c98508c49871c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa4c98508c498723 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179182.866108:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc91317e600/0xaa4c98508c49871c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa4c98508c498723 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179182.866121:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179182.866123:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179182.866125:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179182.866135:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788179182.866147:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9358f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472041216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788179182.866213:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179182.866259:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788179182.866267:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041472041344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788179182.866289:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179182.866315:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472041216 00000100:00100000:3.0:1788179182.866322:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472041216 00000100:00100000:3.0:1788179182.866356:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472041344 00000100:00100000:3.0:1788179182.866359:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472041344 00000100:00100000:3.0:1788179182.866375:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788179182.866382:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc80361bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+18:3307:x1875041472041216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788179182.866393:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179182.866406:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc92e12c000/0xaa4c98508c498c71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa4c98508c498c6a expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179182.866418:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179182.866459:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc80361bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+17:3307:x1875041472041216:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179182.866466:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788179182.866482:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788179182.866487:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc80361b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+16:3306:x1875041472041344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788179182.866495:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179182.866503:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc942173800/0xaa4c98508c498723 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa4c98508c49871c expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179182.866521:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179182.866546:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc80361b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efc6f743-3303-46d5-8807-513b82cac1cc+15:3306:x1875041472041344:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179182.866552:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1788179182.866775:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179182.866857:0:11517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179182.866927:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041472041344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788179182.867314:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041472040704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788179182.867488:0:11517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90710e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efc6f743-3303-46d5-8807-513b82cac1cc+14:3305:x1875041472040576:12345-0@lo:103:ldlm_bl.0 Request processed in 5929us (7592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179182.867496:0:11517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788179182.867695:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc907038e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041472040576:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788179182.868136:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179182.868142:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179182.868156:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875041472040960:0@lo:9:umount.0 00000100:00100000:1.0:1788179182.868195:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179182.868225:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875041472041088:0@lo:9:umount.0 00000100:00100000:1.0:1788179182.868245:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179182.868277:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472040960 00000100:00100000:1.0:1788179182.868282:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472040960 00000100:00100000:1.0:1788179182.868316:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472041088 00000100:00100000:1.0:1788179182.868319:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472041088 00000100:00100000:1.0:1788179182.868347:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788179182.868354:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803601880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875041472040960:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788179182.868378:0:6590:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c4988b2 00000100:00080000:1.0:1788179182.868386:0:6590:0:(import.c:65:import_set_state_nolock()) ffff9bc913617000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788179182.868420:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788179182.869049:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803601880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3304:x1875041472040960:12345-0@lo:9:umount.0 Request processed in 693us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179182.869058:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788179182.869075:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788179182.869082:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803601500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875041472041088:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788179182.869097:0:6590:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c498999 00000100:00080000:1.0:1788179182.869114:0:6590:0:(import.c:65:import_set_state_nolock()) ffff9bc92e137000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788179182.869138:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788179182.869331:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803601500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3304:x1875041472041088:12345-0@lo:9:umount.0 Request processed in 249us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179182.869338:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788179182.869359:0:5792:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788179182.869370:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788179182.869396:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9bc902f15000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788179182.869408:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788179182.869410:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788179182.869413:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875041472040960:0@lo:9:umount.0 00000100:00080000:1.0:1788179182.869424:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9bc8019ef800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788179182.869433:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788179182.869434:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788179182.869437:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875041472041088:0@lo:9:umount.0 00010000:00010000:1.0:1788179182.869481:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179182.869710:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9358f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:3307:1875041472041216:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788179182.874814:0:12925:0:(genops.c:1587:class_disconnect_exports()) OBD device 5 (ffff9bc93abc0000) has no exports 00000020:00000080:2.0:1788179182.960119:0:12925:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c498777 00000020:00000080:2.0:1788179182.960134:0:12925:0:(genops.c:907:class_export_put()) final put ffff9bc90708e800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788179182.960196:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788179182.962611:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788179182.962628:0:12925:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788179182.962633:0:12925:0:(genops.c:1587:class_disconnect_exports()) OBD device 7 (ffff9bc926580000) has no exports 00000020:00000080:3.0:1788179182.963132:0:12925:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c498770 00000020:00000080:3.0:1788179182.963140:0:12925:0:(genops.c:907:class_export_put()) final put ffff9bc905cc9800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788179182.964394:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc90708e800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788179182.973916:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc905cc9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788179182.974165:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788179182.974177:0:12925:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788179182.974182:0:12925:0:(genops.c:907:class_export_put()) final put ffff9bc905ccf800/lustre-QMT0000_UUID 00000020:00000080:1.0:1788179182.974185:0:12925:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc905ccf800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788179182.974190:0:12925:0:(genops.c:442:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:1.0:1788179183.298237:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041472041472:0@lo:400:kworker.0 00000100:00100000:1.0:1788179183.298325:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179183.298616:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472041472 00000100:00100000:0.0:1788179183.298624:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472041472 00000100:00100000:0.0:1788179183.298682:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788179183.298692:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9265ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+14:3306:x1875041472041472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179183.298740:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9265ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efc6f743-3303-46d5-8807-513b82cac1cc+14:3306:x1875041472041472:12345-0@lo:400:kworker.0 Request processed in 49us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179183.298747:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788179183.298976:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041472041472:0@lo:400:kworker.0 00000100:00100000:3.0:1788179183.299102:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875041472041600:0@lo:400:kworker.0 00000100:00100000:3.0:1788179183.299135:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179183.299165:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788179183.299173:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041472041728:0@lo:400:kworker.0 00000100:00100000:3.0:1788179183.299194:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179183.299808:0:12275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472041600 00000100:00100000:1.0:1788179183.299814:0:12275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472041600 00000100:00100000:1.0:1788179183.299872:0:12275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472041728 00000100:00100000:1.0:1788179183.299875:0:12275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472041728 00000100:00100000:1.0:1788179183.299901:0:12275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788179183.299930:0:12275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3307:x1875041472041600:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788179183.299938:0:12275:0:(tgt_handler.c:808:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788179183.299979:0:12275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3307:x1875041472041600:12345-0@lo:400:kworker.0 Request processed in 48us (842us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788179183.299985:0:12275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788179183.300000:0:12275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788179183.300004:0:12275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3307:x1875041472041728:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788179183.300008:0:12275:0:(tgt_handler.c:808:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788179183.300031:0:12275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3307:x1875041472041728:12345-0@lo:400:kworker.0 Request processed in 25us (836us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788179183.300036:0:12275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1788179183.300165:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788179183.300170:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9bc93b620800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788179183.300174:0:3307:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788179183.322035:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9bc93b620800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788179183.322049:0:3307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 188 00000100:00080000:3.0:1788179183.322059:0:3307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bc93b620800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:3.0:1788179183.324032:0:3307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bc803619500 x1875041472041856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788179183.325018:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875041472041856:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788179183.325804:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179183.325905:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472041856 00000100:00100000:2.0:1788179183.325914:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472041856 00000100:00100000:3.0:1788179183.326009:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041472041728:0@lo:400:kworker.0 00000100:00080000:3.0:1788179183.326039:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788179183.326044:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9bc93fb40000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788179183.326047:0:3307:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788179183.326061:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9bc93fb40000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788179183.328241:0:3307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 168 00000100:00080000:3.0:1788179183.328251:0:3307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bc93fb40000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:2.0:1788179183.329059:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788179183.329067:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3304:x1875041472041856:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1788179183.329085:0:5827:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788179183.330029:0:3307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bc80361ad80 x1875041472041984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788179183.330059:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875041472041600:0@lo:400:kworker.0 00000100:00100000:3.0:1788179183.330125:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc80361ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875041472041984:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788179183.330186:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179183.330228:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472041984 00000100:00100000:3.0:1788179183.330235:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472041984 00000100:00100000:3.0:1788179183.330261:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788179183.330267:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1875041472041984:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1788179183.330292:0:5797:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788179183.330331:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1875041472041984:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 63us (145us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788179183.330338:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:3.0:1788179183.334226:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9bc93fb40000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788179183.334239:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788179183.334245:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc80361ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875041472041984:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788179183.368330:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3304:x1875041472041856:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 39253us (42518us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788179183.368346:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:3.0:1788179183.368639:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9bc93b620800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788179183.368646:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788179183.368650:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875041472041856:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:1.0:1788179183.874009:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788179184.410120:0:7496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788179184.410130:0:7496:0:(genops.c:907:class_export_put()) final put ffff9bc92e132800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788179184.411599:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc92e132800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788179184.411662:0:36:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9bc92e137000 for lustre-OST0001 00010000:00010000:1.0:1788179184.906881:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788179184.934582:0:5818:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 176e2bf4-b5b0-4c8a-ad1b-45962a669671 00000001:00080000:1.0:1788179184.934605:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1788179184.934610:0:5818:0:(genops.c:907:class_export_put()) final put ffff9bc93f938800/176e2bf4-b5b0-4c8a-ad1b-45962a669671 00000020:00000080:2.0:1788179184.934839:0:471:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc93f938800/176e2bf4-b5b0-4c8a-ad1b-45962a669671 for lustre-MDT0000 00000020:00000080:2.0:1788179184.934922:0:471:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9bc93f939800 for lustre-MDT0000 00000001:00100000:0.0:1788179184.941122:0:6618:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788179184.941133:0:6618:0:(genops.c:907:class_export_put()) final put ffff9bc913617800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788179184.942206:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc913617800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788179184.942267:0:36:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9bc913617000 for lustre-OST0000 00000020:01000000:1.0:1788179185.024109:0:12925:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bc93f6a71e0 - data ffff9bc91ec361b0/ffff9bc93a5c2c00 00000020:01000000:1.0:1788179185.024423:0:12925:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bc9095e99c0 - data ffff9bc931fa8af8/ffff9bc902fe6400 00000001:00000004:1.0:1788179185.036280:0:12925:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1788179185.178182:0:12925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788179185.178192:0:12925:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1788179185.178206:0:12925:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788179185.178208:0:12925:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788179185.178936:0:6808:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788179185.178953:0:6808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1788179185.178964:0:6808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788179185.180290:0:12925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788179185.180296:0:12925:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1788179185.180312:0:12925:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788179185.180315:0:12925:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788179185.182170:0:7776:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788179185.182176:0:7776:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1788179185.182187:0:7776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788179185.333471:0:12925:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c49873f 00000020:00000080:0.0:1788179185.333488:0:12925:0:(genops.c:907:class_export_put()) final put ffff9bc91360d000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788179185.333700:0:471:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc91360d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788179185.335202:0:12925:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c498754 00000020:00000080:0.0:1788179185.335212:0:12925:0:(genops.c:907:class_export_put()) final put ffff9bc93abd6800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788179185.335268:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788179185.335275:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788179185.335284:0:12925:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788179185.335288:0:12925:0:(genops.c:1587:class_disconnect_exports()) OBD device 4 (ffff9bc93abc19c0) has no exports 00000004:01000000:0.0:1788179185.335466:0:12925:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788179185.335476:0:12925:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c498992 00000020:00000080:0.0:1788179185.335481:0:12925:0:(genops.c:907:class_export_put()) final put ffff9bc935480800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788179185.336068:0:471:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc93abd6800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788179185.336224:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788179185.336230:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788179185.336238:0:12925:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788179185.336242:0:12925:0:(genops.c:1587:class_disconnect_exports()) OBD device 17 (ffff9bc93b67b380) has no exports 00000020:00000080:0.0:1788179185.336248:0:12925:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c49898b 00000020:00000080:0.0:1788179185.336252:0:12925:0:(genops.c:907:class_export_put()) final put ffff9bc935482000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788179185.336665:0:471:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc935480800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788179185.336674:0:471:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc935482000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788179185.336763:0:12925:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788179185.336767:0:12925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788179185.336772:0:12925:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1788179185.336777:0:12925:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788179185.336779:0:12925:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788179185.336819:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788179185.336825:0:12925:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788179185.336831:0:12925:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c4988ab 00000020:00000080:0.0:1788179185.336836:0:12925:0:(genops.c:907:class_export_put()) final put ffff9bc93f8ff800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788179185.336839:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788179185.336843:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788179185.336877:0:12925:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788179185.336880:0:12925:0:(genops.c:1587:class_disconnect_exports()) OBD device 13 (ffff9bc905c20000) has no exports 00000020:00000080:0.0:1788179185.336884:0:12925:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c4988a4 00000020:00000080:0.0:1788179185.336887:0:12925:0:(genops.c:907:class_export_put()) final put ffff9bc902f10800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788179185.337181:0:12925:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788179185.337184:0:12925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788179185.337187:0:12925:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1788179185.337190:0:12925:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788179185.337192:0:12925:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788179185.337215:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788179185.337219:0:12925:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788179185.337257:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788179185.337260:0:12925:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788179185.337263:0:12925:0:(genops.c:907:class_export_put()) final put ffff9bc920042800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788179185.337266:0:12925:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc920042800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788179185.337270:0:12925:0:(genops.c:442:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788179185.337448:0:12925:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c49875b 00000020:00000080:0.0:1788179185.337453:0:12925:0:(genops.c:907:class_export_put()) final put ffff9bc93abd4800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788179185.337456:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788179185.337460:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788179185.337463:0:12925:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788179185.337466:0:12925:0:(genops.c:1587:class_disconnect_exports()) OBD device 6 (ffff9bc93abc3380) has no exports 00000020:00000080:0.0:1788179185.337483:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788179185.337487:0:12925:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788179185.337490:0:12925:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c498762 00000020:00000080:0.0:1788179185.337492:0:12925:0:(genops.c:907:class_export_put()) final put ffff9bc93abd7000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788179185.337499:0:12925:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bc9070e2800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788179185.337502:0:12925:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bc9070e2800 3 00000020:01000004:0.0:1788179185.337505:0:12925:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bc9070e2800 from lustre-MDT0000 00000020:00000080:0.0:1788179185.337520:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788179185.337522:0:12925:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788179185.337525:0:12925:0:(genops.c:907:class_export_put()) final put ffff9bc913608000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788179185.337532:0:12925:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc913608000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788179185.337538:0:12925:0:(genops.c:442:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788179185.337562:0:12925:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:00000080:3.0:1788179185.337725:0:471:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9bc8019ef800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788179185.337732:0:471:0:(genops.c:907:class_export_put()) final put ffff9bc93b626800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788179185.337734:0:471:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc93b626800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788179185.337738:0:471:0:(genops.c:442:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788179185.337783:0:471:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc93f8ff800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788179185.337786:0:471:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc902f10800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788179185.337791:0:471:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9bc902f15000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788179185.337794:0:471:0:(genops.c:907:class_export_put()) final put ffff9bc934be1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788179185.337796:0:471:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc934be1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788179185.337799:0:471:0:(genops.c:442:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788179185.337877:0:471:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc93abd4800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788179185.337880:0:471:0:(genops.c:907:class_export_put()) final put ffff9bc920042000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788179185.337882:0:471:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc920042000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788179185.337885:0:471:0:(genops.c:442:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788179185.338047:0:471:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc93abd7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1788179185.338119:0:12925:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788179185.338123:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788179185.338127:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788179185.338129:0:12925:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788179185.338135:0:12925:0:(genops.c:1848:print_export_data()) MGS: ACTIVE ffff9bc91360f000 efc6f743-3303-46d5-8807-513b82cac1cc 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788179185.338140:0:12925:0:(genops.c:1582:class_disconnect_exports()) OBD device 1 (ffff9bc9265c3380) has exports, disconnecting them 00000020:00080000:0.0:1788179185.338145:0:12925:0:(genops.c:1557:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9bc91360f000), last request at 1788178953 00000020:00000080:0.0:1788179185.338159:0:12925:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c498700 00000020:00010000:0.0:1788179185.338164:0:12925:0:(genops.c:1950:obd_stale_export_put()) Put export ffff9bc91360f000: total 0 00000100:00080000:0.0:1788179185.338168:0:12925:0:(import.c:65:import_set_state_nolock()) ffff9bc92018f000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788179185.338217:0:12925:0:(genops.c:1562:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bc91360f000): rc 0 00000020:00080000:0.0:1788179185.338222:0:12925:0:(genops.c:1587:class_disconnect_exports()) OBD device 1 (ffff9bc9265c3380) has no exports 00000100:00100000:0.0:1788179185.338283:0:5791:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9bc926be3000:5791] 2 exiting: rc = 0 00000100:00100000:0.0:1788179185.338442:0:5789:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9bc9180ae000:5789] 0 exiting: rc = 1 00000100:00100000:3.0:1788179185.338790:0:5790:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9bc926be3400:5790] 1 exiting: rc = 0 00000100:00100000:0.0:1788179185.338958:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.338967:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.338974:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.338980:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.338986:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.338991:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.338997:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339003:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339009:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339014:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339019:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339024:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339031:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339036:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339042:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339056:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339062:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339066:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339072:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339077:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339083:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339089:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339095:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339101:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339106:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339111:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339116:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339121:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339127:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339132:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339137:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339143:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339148:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339153:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339158:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339163:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339168:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339173:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339178:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339183:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339188:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339193:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339198:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339203:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339208:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339212:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339217:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339222:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339226:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339231:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339241:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339246:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339251:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339257:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339262:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339267:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339272:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339277:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339283:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339288:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339293:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339298:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339304:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.339309:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1788179185.339795:0:12925:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788179185.339799:0:12925:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00010000:1.0:1788179185.340211:0:6606:0:(genops.c:1936:obd_stale_export_get()) Get export ffff9bc91360f000: total 0 00010000:00010000:1.0:1788179185.340255:0:6606:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9bc91360f000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788179185.340286:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc9136c4800/0xaa4c98508c498a2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa4c98508c498a25 expref: 9 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179185.340302:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc92e12ce00/0xaa4c98508c498a1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa4c98508c498a17 expref: 8 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179185.340325:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc900031e00/0xaa4c98508c498c55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa4c98508c498c4e expref: 7 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179185.340347:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc9137b5400/0xaa4c98508c498a3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa4c98508c498a33 expref: 6 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179185.340361:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc91317ea00/0xaa4c98508c498818 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa4c98508c498811 expref: 5 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179185.340376:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc9137b4000/0xaa4c98508c498a64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa4c98508c498a5d expref: 4 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179185.340386:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc92e12ca00/0xaa4c98508c498c63 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa4c98508c498c5c expref: 3 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179185.340408:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc9136c5a00/0xaa4c98508c498a10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xaa4c98508c498a09 expref: 2 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179185.340420:0:6606:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9bc91360f000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1788179185.340446:0:6606:0:(genops.c:907:class_export_put()) final put ffff9bc91360f000/efc6f743-3303-46d5-8807-513b82cac1cc 00010000:00010000:1.0:1788179185.340461:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179185.340463:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179185.340465:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788179185.342500:0:471:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc91360f000/efc6f743-3303-46d5-8807-513b82cac1cc for MGS 00000020:00000080:0.0:1788179185.342558:0:471:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9bc92018f000 for MGS 00000020:01000000:0.0:1788179185.346294:0:12925:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bc803c1f0c0 - data ffff9bc93ff30510/ffff9bc92e8bcc00 00000020:01000000:0.0:1788179185.346407:0:12925:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bc909599420 - data ffff9bc931ce0798/ffff9bc910ba1400 00000020:00000080:0.0:1788179185.346969:0:12925:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c4986e4 00000020:00000080:0.0:1788179185.346977:0:12925:0:(genops.c:907:class_export_put()) final put ffff9bc90f7a1800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788179185.346992:0:12925:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bc9070e2800 from MGS, refs=2 00000020:01000004:0.0:1788179185.346995:0:12925:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bc9070e2800 2 00000020:01000004:0.0:1788179185.346998:0:12925:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bc9070e2800 from MGS 00000020:00000080:0.0:1788179185.347023:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788179185.347030:0:12925:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788179185.347032:0:12925:0:(genops.c:907:class_export_put()) final put ffff9bc90f7a4000/MGS 00000020:00000080:0.0:1788179185.347035:0:12925:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc90f7a4000/MGS for MGS 00000020:01000000:0.0:1788179185.347041:0:12925:0:(genops.c:442:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788179185.347100:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788179185.347104:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788179185.347110:0:12925:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788179185.347116:0:12925:0:(genops.c:1848:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9bc926644800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788179185.347132:0:12925:0:(genops.c:1582:class_disconnect_exports()) OBD device 8 (ffff9bc9265c4d40) has exports, disconnecting them 00000020:00080000:0.0:1788179185.347137:0:12925:0:(genops.c:1557:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9bc926644800), last request at 1788178954 00000020:00000080:0.0:1788179185.347141:0:12925:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c4987af 00000020:00080000:0.0:1788179185.347148:0:12925:0:(genops.c:1562:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bc926644800): rc 0 00000020:00000080:0.0:1788179185.347152:0:12925:0:(genops.c:907:class_export_put()) final put ffff9bc926644800/lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788179185.347706:0:12925:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788179185.347711:0:12925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788179185.347715:0:12925:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788179185.347721:0:12925:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788179185.347821:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788179185.347827:0:12925:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788179185.347831:0:12925:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bc9070e2800 1 00000020:00000080:0.0:1788179185.347836:0:12925:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c4986d6 00000020:00000080:0.0:1788179185.347840:0:12925:0:(genops.c:907:class_export_put()) final put ffff9bc90f7a7800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788179185.347843:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788179185.347871:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788179185.347875:0:12925:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788179185.347877:0:12925:0:(genops.c:1587:class_disconnect_exports()) OBD device 0 (ffff9bc905c24d40) has no exports 00000020:00000080:1.0:1788179185.348028:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc90f7a1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788179185.348045:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc926644800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788179185.348051:0:36:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9bc926643800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788179185.348057:0:36:0:(genops.c:907:class_export_put()) final put ffff9bc90708b800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788179185.348060:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc90708b800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788179185.348064:0:36:0:(genops.c:442:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788179185.348121:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc90f7a7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788179185.433773:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788179185.433789:0:12925:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788179185.433796:0:12925:0:(genops.c:907:class_export_put()) final put ffff9bc9070e6000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788179185.433800:0:12925:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc9070e6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788179185.433809:0:12925:0:(genops.c:442:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788179185.434973:0:12925:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bc9070e4800 00000020:01000000:0.0:1788179185.435052:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788179185.435056:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788179185.435061:0:12925:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788179185.435066:0:12925:0:(genops.c:1587:class_disconnect_exports()) OBD device 3 (ffff9bc905c219c0) has no exports 00000100:00100000:1.0:1788179185.436241:0:5796:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9bc920183000:5796] 0 exiting: rc = 1 00000100:00100000:1.0:1788179185.436466:0:12275:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9bc93ab73800:12275] 4 exiting: rc = 0 00000100:00100000:2.0:1788179185.436549:0:5827:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9bc918316200:5827] 3 exiting: rc = 0 00000100:00100000:0.0:1788179185.436724:0:5798:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9bc9266d8800:5798] 2 exiting: rc = 0 00000100:00100000:0.0:1788179185.437089:0:5797:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9bc920182400:5797] 1 exiting: rc = 0 00000100:00100000:0.0:1788179185.437158:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437174:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437179:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437184:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437190:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437194:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437200:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437205:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437210:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437214:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437219:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437224:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437229:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437233:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437238:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437243:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437248:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437253:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437258:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437264:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437268:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437274:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437279:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437284:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437289:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437294:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437300:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437306:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437312:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437317:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437322:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437327:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437332:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437337:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437343:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437348:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437359:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437364:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437370:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437376:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437382:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437388:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437394:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437399:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437404:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437409:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437416:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437421:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437439:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437445:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437452:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437457:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437462:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437467:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437472:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437477:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437483:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437487:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437492:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437497:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437502:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437507:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437512:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.437523:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.441181:0:5800:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9bc9266d9e00:5800] 1 exiting: rc = 0 00000100:00100000:0.0:1788179185.441967:0:5799:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9bc9323fac00:5799] 0 exiting: rc = 1 00000100:00100000:1.0:1788179185.442755:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.442764:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.442770:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.442776:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.442782:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.442787:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.442793:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.442798:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.442803:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.442809:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.442814:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.442820:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.442825:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.442830:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.442835:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.442844:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.442865:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.442870:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.442875:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.442880:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.442885:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.442889:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.442961:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.442968:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.442973:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.442978:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.442983:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443049:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443054:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443059:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443075:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443080:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443085:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443089:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443094:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443099:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443104:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443109:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443115:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443125:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443130:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443135:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443140:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443145:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443150:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443154:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443158:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443162:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443167:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443172:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443176:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443180:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443185:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443227:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443232:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443236:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443241:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443245:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443249:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443254:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443258:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443263:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443267:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.443272:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.444154:0:5801:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9bc920180000:5801] 0 exiting: rc = 1 00000100:00100000:2.0:1788179185.444170:0:5802:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9bc920195000:5802] 1 exiting: rc = 0 00000100:00100000:3.0:1788179185.444308:0:12320:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9bc9067dfe00:12320] 2 exiting: rc = 0 00000100:00100000:1.0:1788179185.444576:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.444593:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.444599:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.444605:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.444611:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.444617:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.444642:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.444648:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.444654:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.444659:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.444665:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.444671:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.444677:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445172:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445183:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445189:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445194:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445200:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445221:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445229:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445234:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445240:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445247:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445270:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445275:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445281:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445286:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445465:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445473:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445479:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445500:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445507:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445512:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445519:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445524:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445530:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445547:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445554:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445560:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445566:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445572:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445579:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445585:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445591:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445597:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445602:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445624:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445633:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445641:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445647:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445654:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445662:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445668:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445674:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445680:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445685:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445691:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445697:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445765:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445773:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445778:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445785:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445790:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179185.445796:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.459975:0:5803:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9bc920195200:5803] 0 exiting: rc = 1 00000100:00100000:3.0:1788179185.460079:0:5804:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9bc920195400:5804] 1 exiting: rc = 0 00000100:00100000:3.0:1788179185.460141:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460147:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460152:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460157:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460162:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460167:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460172:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460176:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460180:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460185:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460189:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460193:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460198:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460202:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460206:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460210:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460215:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460219:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460223:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460227:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460231:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460235:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460239:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460243:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460248:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460252:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460255:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460259:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460263:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460267:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460272:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460415:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460420:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460433:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460438:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460442:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460447:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460452:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460456:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460460:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460465:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460470:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460474:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460479:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460483:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460488:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460492:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460497:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460501:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460505:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460509:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460513:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460517:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460521:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460525:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460529:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460533:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460538:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460542:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460546:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460550:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460554:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460559:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460563:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.460873:0:5805:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9bc920195800:5805] 0 exiting: rc = 1 00000100:00100000:0.0:1788179185.461103:0:5806:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9bc920180c00:5806] 1 exiting: rc = 0 00000100:00100000:3.0:1788179185.461177:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461190:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461194:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461199:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461204:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461208:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461213:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461217:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461221:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461226:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461231:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461235:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461239:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461243:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461248:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461252:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461256:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461260:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461264:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461269:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461273:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461277:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461281:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461285:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461298:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461302:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461307:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461311:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461316:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461320:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461324:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461328:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461452:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461459:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461463:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461468:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461478:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461482:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461486:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461491:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461495:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461500:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461505:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461509:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461514:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461518:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461522:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461526:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461530:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461534:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461538:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461542:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461546:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461550:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461554:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461558:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461563:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461567:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461572:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461577:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461581:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461585:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461589:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.461593:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.462020:0:5807:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9bc920194000:5807] 0 exiting: rc = 1 00000100:00100000:3.0:1788179185.462156:0:5808:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9bc920195c00:5808] 1 exiting: rc = 0 00000100:00100000:3.0:1788179185.462195:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462200:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462204:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462209:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462214:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462219:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462229:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462234:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462239:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462244:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462248:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462253:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462258:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462262:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462267:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462271:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462276:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462280:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462284:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462288:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462304:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462309:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462313:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462317:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462322:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462326:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462331:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462467:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462474:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462478:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462483:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462488:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462492:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462497:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462502:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462506:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462511:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462515:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462519:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462524:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462528:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462539:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462543:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462548:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462553:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462557:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462562:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462566:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462571:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462576:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462581:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462585:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462589:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462594:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462599:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462604:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462609:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462614:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462619:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462624:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462629:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462637:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462642:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.462647:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179185.463056:0:5809:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9bc9180aea00:5809] 0 exiting: rc = 1 00000100:00100000:2.0:1788179185.463286:0:5810:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9bc9180ae200:5810] 1 exiting: rc = 0 00000100:00100000:2.0:1788179185.463452:0:5811:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9bc9180afc00:5811] 2 exiting: rc = 0 00000100:00100000:3.0:1788179185.463521:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463528:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463534:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463540:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463545:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463550:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463556:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463561:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463566:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463573:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463579:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463600:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463612:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463619:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463625:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463630:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463635:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463639:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463645:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463651:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463655:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463661:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463665:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463670:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463676:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463681:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463686:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463691:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463696:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463700:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463706:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463712:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463777:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463788:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463793:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463812:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463818:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463824:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463829:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463834:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463840:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463845:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463978:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.463983:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.464038:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.464042:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.464046:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.464056:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.464059:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.464063:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.464067:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.464071:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.464075:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.464078:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.464081:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.464085:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.464088:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.464092:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.464095:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.464099:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.464102:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.464105:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.464109:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179185.464117:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788179185.469212:0:12925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788179185.469224:0:12925:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788179185.469229:0:12925:0:(genops.c:907:class_export_put()) final put ffff9bc91360a800/MDS_uuid 00000020:00000080:2.0:1788179185.469234:0:12925:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc91360a800/MDS_uuid for MDS 00000020:01000000:2.0:1788179185.469242:0:12925:0:(genops.c:442:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788179185.469506:0:12925:0:(tgt_mount.c:2258:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788179185.921430:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179186.946798:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179187.975460:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788179188.218447:0:13076:0:(tgt_mount.c:2269:server_umount_begin()) umount -f 00000020:01000004:1.0:1788179188.226989:0:13076:0:(tgt_mount.c:2129:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788179188.227041:0:13076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900031a00/0xaa4c98508c498a25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a2c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179188.227061:0:13076:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900031a00/0xaa4c98508c498a25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498a2c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179188.227066:0:13076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900031a00/0xaa4c98508c498a25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa4c98508c498a2c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179188.227070:0:13076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff9bc900031a00/0xaa4c98508c498a25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa4c98508c498a2c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179188.227087:0:13076:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788179188.227091:0:13076:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1788179188.227107:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788179188.227113:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc900031a00/0xaa4c98508c498a25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa4c98508c498a2c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788179188.227114:0:13076:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788179188.227118:0:13076:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1788179188.227121:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc900031a00 already unused, calling callback (ffffffffc1c63c20) 00000100:00080000:1.0:1788179188.227123:0:13076:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 10000000:00010000:2.0:1788179188.227125:0:6606:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc900031a00/0xaa4c98508c498a25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa4c98508c498a2c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788179188.227128:0:13076:0:(import.c:65:import_set_state_nolock()) ffff9bc93fb40000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788179188.227133:0:13076:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788179188.227135:0:13076:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00010000:00010000:2.0:1788179188.227137:0:6606:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc900031a00/0xaa4c98508c498a25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa4c98508c498a2c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179188.227137:0:13076:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:00010000:2.0:1788179188.227143:0:6606:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc900031a00/0xaa4c98508c498a25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa4c98508c498a2c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788179188.227149:0:6606:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788179188.227151:0:6606:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788179188.227154:0:6606:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788179188.227187:0:6606:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc900031a00/0xaa4c98508c498a25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa4c98508c498a2c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179188.227193:0:6606:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788179188.227226:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc900031a00/0xaa4c98508c498a25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa4c98508c498a2c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179188.227233:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc900031a00/0xaa4c98508c498a25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa4c98508c498a2c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179188.227245:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179188.227247:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179188.227249:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788179188.227256:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788179188.227271:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc907039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041472042112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788179188.227341:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179188.227372:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472042112 00000100:00100000:3.0:1788179188.227379:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472042112 00000100:00100000:3.0:1788179188.227430:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788179188.227437:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907039500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3306:x1875041472042112:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788179188.227443:0:5781:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788179188 with bad export cookie 12271350556396193536 00010000:00010000:1.0:1788179188.229032:0:13076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc92e12cc00/0xaa4c98508c498a33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a3a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179188.229047:0:13076:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc92e12cc00/0xaa4c98508c498a33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498a3a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179188.229053:0:13076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc92e12cc00/0xaa4c98508c498a33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa4c98508c498a3a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179188.229060:0:13076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff9bc92e12cc00/0xaa4c98508c498a33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa4c98508c498a3a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179188.229090:0:13076:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788179188.229104:0:6605:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788179188.229109:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc92e12cc00/0xaa4c98508c498a33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa4c98508c498a3a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179188.229115:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92e12cc00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:1.0:1788179188.229119:0:6605:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc92e12cc00/0xaa4c98508c498a33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa4c98508c498a3a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179188.229127:0:6605:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc92e12cc00/0xaa4c98508c498a33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa4c98508c498a3a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788179188.229134:0:6605:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc92e12cc00/0xaa4c98508c498a33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa4c98508c498a3a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788179188.229140:0:6605:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788179188.229143:0:6605:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1788179188.229167:0:6605:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc92e12cc00/0xaa4c98508c498a33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa4c98508c498a3a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179188.229173:0:6605:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788179188.229187:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc92e12cc00/0xaa4c98508c498a33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa4c98508c498a3a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179188.229193:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc92e12cc00/0xaa4c98508c498a33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa4c98508c498a3a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179188.229204:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179188.229205:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179188.229213:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179188.229225:0:13076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c800/0xaa4c98508c498c5c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498c63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179188.229232:0:13076:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c800/0xaa4c98508c498c5c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498c63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179188.229237:0:13076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c800/0xaa4c98508c498c5c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa4c98508c498c63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179188.229243:0:13076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c800/0xaa4c98508c498c5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa4c98508c498c63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179188.229254:0:13076:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788179188.229378:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788179188.229411:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041472042240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788179188.229461:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179188.229512:0:11517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472042240 00000100:00100000:0.0:1788179188.229518:0:11517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472042240 00000100:00100000:0.0:1788179188.229545:0:11517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788179188.229551:0:11517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3305:x1875041472042240:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788179188.229557:0:11517:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788179188 with bad export cookie 12271350556396193536 00000100:00100000:0.0:1788179188.229599:0:11517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3305:x1875041472042240:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (137us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788179188.229606:0:11517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788179188.229640:0:3305:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.102@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788179188.229645:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9bc90577f000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788179188.229648:0:3305:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 10000000:01000000:1.0:1788179188.229674:0:13076:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1788179188.229679:0:13076:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788179188.229697:0:13076:0:(tgt_mount.c:2189:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788179188.229700:0:13076:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:1.0:1788179188.229709:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788179188.229714:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c800/0xaa4c98508c498c5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa4c98508c498c63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179188.229721:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92e12c800 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:1.0:1788179188.229724:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c800/0xaa4c98508c498c5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa4c98508c498c63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179188.229732:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c800/0xaa4c98508c498c5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa4c98508c498c63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788179188.229739:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c800/0xaa4c98508c498c5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa4c98508c498c63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788179188.229754:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788179188.229757:0:5784:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788179188.229758:0:5784:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00080000:0.0:1788179188.241390:0:3305:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.102@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788179188.241395:0:3305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788179188.241412:0:3305:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bc907039880 x1875041472042112/t0(0) o103->MGC192.168.202.102@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788179204 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179188.241434:0:3305:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bc803602d80 x1875041472042240/t0(0) o103->MGC192.168.202.102@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788179204 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788179188.241449:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788179188.241452:0:3305:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788179188.241453:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788179188.241457:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9bc90577f000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788179188.241461:0:3305:0:(import.c:510:import_select_connection()) MGC192.168.202.102@tcp: connect to NID 0@lo last attempt 149 00000100:00080000:0.0:1788179188.241469:0:3305:0:(import.c:624:import_select_connection()) MGC192.168.202.102@tcp: import ffff9bc90577f000 using connection 192.168.202.102@tcp/0@lo 00010000:00010000:1.0:1788179188.241480:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c800/0xaa4c98508c498c5c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa4c98508c498c63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179188.241489:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788179188.241499:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc907039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efc6f743-3303-46d5-8807-513b82cac1cc:3306:1875041472042112:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788179188.241510:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c800/0xaa4c98508c498c5c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa4c98508c498c63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179188.241518:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc92e12c800/0xaa4c98508c498c5c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xaa4c98508c498c63 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179188.241532:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179188.241535:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179188.241537:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788179188.241551:0:13076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788179188.241561:0:13076:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788179188.241565:0:13076:0:(genops.c:1587:class_disconnect_exports()) OBD device 11 (ffff9bc93abc4d40) has no exports 00000020:00080000:1.0:1788179188.241590:0:13076:0:(genops.c:1587:class_disconnect_exports()) OBD device 11 (ffff9bc93abc4d40) has no exports 00000100:00100000:0.0:1788179188.243256:0:3305:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bc935a22300 x1875041472042496/t0(0) o250->MGC192.168.202.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788179188.243303:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efc6f743-3303-46d5-8807-513b82cac1cc:3305:1875041472042240:0@lo:103:ldlm_bl.0 00000020:01000000:1.0:1788179188.243334:0:13076:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bc93f6a7540 - data ffff9bc93fe2ed80/ffff9bc93a5c0000 00000020:01000000:1.0:1788179188.243501:0:13076:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bc90fb7a180 - data ffff9bc931f91360/ffff9bc93fad4800 00000100:00100000:2.0:1788179188.245019:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efc6f743-3303-46d5-8807-513b82cac1cc:0:1875041472042368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788179188.247931:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:efc6f743-3303-46d5-8807-513b82cac1cc:3304:1875041472042496:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1788179188.247994:0:3304:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875041472042496 offset 0 length 520: 4 00000400:00000100:3.0:1788179188.249131:0:5781:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875041472042112 offset 224 length 224: 4 00000100:00100000:3.0:1788179188.249146:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907039500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3306:x1875041472042112:12345-0@lo:103:ldlm_bl.0 Request processed in 21708us (21805us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788179188.249155:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00100000:10000000:1.0:1788179188.263460:0:13076:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788179188.287136:0:13076:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c498834 00000020:00000080:1.0:1788179188.287147:0:13076:0:(genops.c:907:class_export_put()) final put ffff9bc93a96c800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788179188.287161:0:13076:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bc913608800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788179188.287165:0:13076:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bc913608800 2 00000020:01000004:1.0:1788179188.287168:0:13076:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bc913608800 from lustre-OST0000 00000020:00000080:1.0:1788179188.287192:0:13076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788179188.287202:0:13076:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788179188.287216:0:13076:0:(genops.c:907:class_export_put()) final put ffff9bc93a96c000/lustre-OST0000_UUID 00000020:00000080:1.0:1788179188.287219:0:13076:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc93a96c000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788179188.287227:0:13076:0:(genops.c:442:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788179188.287721:0:13076:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788179188.287727:0:13076:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788179188.287732:0:13076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788179188.287737:0:13076:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788179188.287744:0:13076:0:(genops.c:1848:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9bc93a968800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788179188.287749:0:13076:0:(genops.c:1582:class_disconnect_exports()) OBD device 12 (ffff9bc93fb3b380) has exports, disconnecting them 00000020:00080000:1.0:1788179188.287754:0:13076:0:(genops.c:1557:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9bc93a968800), last request at 1788178972 00000020:00000080:1.0:1788179188.287758:0:13076:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c49885e 00000020:00080000:1.0:1788179188.287771:0:13076:0:(genops.c:1562:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bc93a968800): rc 0 00000020:00000080:1.0:1788179188.287775:0:13076:0:(genops.c:907:class_export_put()) final put ffff9bc93a968800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788179188.288650:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc93a96c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788179188.288667:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc93a968800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788179188.290912:0:13076:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788179188.290921:0:13076:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788179188.290926:0:13076:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788179188.290933:0:13076:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788179188.291085:0:13076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788179188.291093:0:13076:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788179188.291100:0:13076:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bc913608800 1 00000020:00000080:2.0:1788179188.291107:0:13076:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c4987ee 00000020:00000080:2.0:1788179188.291125:0:13076:0:(genops.c:907:class_export_put()) final put ffff9bc934be2800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788179188.291132:0:13076:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788179188.291137:0:13076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788179188.291139:0:36:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9bc93fb40000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788179188.291141:0:13076:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788179188.291147:0:13076:0:(genops.c:1587:class_disconnect_exports()) OBD device 9 (ffff9bc926583380) has no exports 00000020:00000080:3.0:1788179188.291149:0:36:0:(genops.c:907:class_export_put()) final put ffff9bc93a968000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788179188.291153:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc93a968000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788179188.291165:0:36:0:(genops.c:442:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788179188.291237:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc934be2800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788179188.319481:0:13076:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788179188.319496:0:13076:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788179188.319502:0:13076:0:(genops.c:907:class_export_put()) final put ffff9bc9267f3000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788179188.319506:0:13076:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc9267f3000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788179188.319516:0:13076:0:(genops.c:442:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788179188.319651:0:13076:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bc9267f7800 00000020:02000400:3.0:1788179188.319694:0:13076:0:(tgt_mount.c:2258:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:2.0:1788179188.422224:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788179188.422236:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788179188.422240:0:471:0:(import.c:65:import_set_state_nolock()) ffff9bc93b620800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788179188.422249:0:471:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 379 00000100:00080000:2.0:1788179188.422255:0:471:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788179188.422262:0:471:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bc93b620800 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:2.0:1788179188.422298:0:471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bc90703ad80 x1875041472042624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788179188.431055:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc90703ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875041472042624:0@lo:38:kworker.0 00000400:00000100:0.0:1788179188.431126:0:3304:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875041472042624 offset 0 length 520: 4 00010000:00010000:1.0:1788179189.000713:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179190.015970:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179191.042493:0:6605:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788179191.412993:0:13226:0:(tgt_mount.c:2269:server_umount_begin()) umount -f 00000020:01000004:3.0:1788179191.432146:0:13226:0:(tgt_mount.c:2129:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788179191.433379:0:13226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c498a09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a10 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179191.433400:0:13226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c498a09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498a10 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179191.433408:0:13226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c498a09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa4c98508c498a10 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179191.433429:0:13226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c498a09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa4c98508c498a10 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179191.433456:0:13226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788179191.433463:0:13226:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788179191.433492:0:13226:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788179191.433507:0:13226:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bc90703ad80 x1875041472042624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788179203 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179191.433527:0:13226:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788179191.433533:0:13226:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788179191.433539:0:13226:0:(import.c:65:import_set_state_nolock()) ffff9bc93b620800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788179191.433544:0:13226:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788179191.433548:0:13226:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bc90703ad80 x1875041472042624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788179203 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179191.433554:0:13226:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788179191.433557:0:13226:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00010000:00010000:1.0:1788179191.433783:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788179191.433791:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c498a09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa4c98508c498a10 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179191.433798:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc900030e00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:1.0:1788179191.433802:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c498a09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa4c98508c498a10 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179191.433810:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c498a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa4c98508c498a10 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788179191.433818:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c498a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa4c98508c498a10 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788179191.433824:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788179191.433834:0:5784:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788179191.433837:0:5784:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788179191.433943:0:5784:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bc90577f000 00010000:00010000:1.0:1788179191.433947:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c498a09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa4c98508c498a10 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179191.433954:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc900030e00/0xaa4c98508c498a09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa4c98508c498a10 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179191.433965:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179191.433966:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179191.433968:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179191.434036:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc90703ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875041472042624:0@lo:38:kworker.0 00010000:00010000:2.0:1788179191.436070:0:13226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498a17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498a1e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179191.436088:0:13226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498a17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498a1e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179191.436096:0:13226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498a17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa4c98508c498a1e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179191.436112:0:13226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498a17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa4c98508c498a1e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179191.436148:0:13226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788179191.436156:0:13226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d200/0xaa4c98508c498c4e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c498c55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179191.436163:0:13226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d200/0xaa4c98508c498c4e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c498c55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179191.436169:0:13226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d200/0xaa4c98508c498c4e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa4c98508c498c55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179191.436175:0:13226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d200/0xaa4c98508c498c4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xaa4c98508c498c55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179191.436193:0:13226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788179191.436197:0:13226:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788179191.436221:0:13226:0:(tgt_mount.c:2189:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788179191.436226:0:13226:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788179191.436230:0:13226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788179191.436235:0:13226:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788179191.436239:0:13226:0:(genops.c:1587:class_disconnect_exports()) OBD device 15 (ffff9bc926584d40) has no exports 00000020:00080000:2.0:1788179191.436267:0:13226:0:(genops.c:1587:class_disconnect_exports()) OBD device 15 (ffff9bc926584d40) has no exports 00010000:00010000:3.0:1788179191.438010:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788179191.438023:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498a17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa4c98508c498a1e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179191.438034:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc900031200 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:3.0:1788179191.438039:0:6606:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498a17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa4c98508c498a1e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179191.438049:0:6606:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa4c98508c498a1e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788179191.438057:0:6606:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa4c98508c498a1e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788179191.438063:0:6606:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788179191.438065:0:6606:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1788179191.438068:0:6606:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1788179191.438087:0:6606:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bc90577f000 00010000:00010000:3.0:1788179191.438091:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498a17 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa4c98508c498a1e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179191.438097:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc900031200/0xaa4c98508c498a17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa4c98508c498a1e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179191.438129:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788179191.438133:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d200/0xaa4c98508c498c4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa4c98508c498c55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179191.438139:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92e12d200 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:3.0:1788179191.438141:0:6606:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d200/0xaa4c98508c498c4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xaa4c98508c498c55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179191.438148:0:6606:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d200/0xaa4c98508c498c4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa4c98508c498c55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788179191.438153:0:6606:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d200/0xaa4c98508c498c4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa4c98508c498c55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788179191.438158:0:6606:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788179191.438161:0:6606:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788179191.438163:0:6606:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788179191.438170:0:6606:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bc90577f000 00010000:00010000:3.0:1788179191.438173:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d200/0xaa4c98508c498c4e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa4c98508c498c55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179191.438179:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc92e12d200/0xaa4c98508c498c4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa4c98508c498c55 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179191.438191:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179191.438192:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179191.438194:0:6606:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179191.440321:0:5785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788179191.440755:0:13226:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bc93f6a7960 - data ffff9bc93ff32510/ffff9bc93a5c3400 00000020:01000000:2.0:1788179191.440928:0:13226:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9bc93b66d900 - data ffff9bc91eeb3000/ffff9bc92e8bd800 00100000:10000000:3.0:1788179191.458443:0:13226:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788179191.492216:0:13226:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c4988ff 00000020:00000080:0.0:1788179191.492226:0:13226:0:(genops.c:907:class_export_put()) final put ffff9bc93a96f800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788179191.492246:0:13226:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bc902f11000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788179191.492250:0:13226:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bc902f11000 2 00000020:01000004:0.0:1788179191.492253:0:13226:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9bc902f11000 from lustre-OST0001 00000020:00000080:0.0:1788179191.492285:0:13226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788179191.492294:0:13226:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788179191.492297:0:13226:0:(genops.c:907:class_export_put()) final put ffff9bc90708f800/lustre-OST0001_UUID 00000020:00000080:0.0:1788179191.492300:0:13226:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc90708f800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788179191.492306:0:13226:0:(genops.c:442:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788179191.492406:0:13226:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import efc6f743-3303-46d5-8807-513b82cac1cc->MGS 00010000:00010000:0.0:1788179191.492421:0:13226:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc901498600/0xaa4c98508c498811 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa4c98508c498818 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788179191.492433:0:13226:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc901498600/0xaa4c98508c498811 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa4c98508c498818 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788179191.492440:0:13226:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788179191.492442:0:13226:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788179191.492445:0:13226:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788179191.492473:0:13226:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bc90577f000 00010000:00010000:0.0:1788179191.492477:0:13226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc901498600/0xaa4c98508c498811 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa4c98508c498818 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179191.492492:0:13226:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc900031600/0xaa4c98508c498a5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xaa4c98508c498a64 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788179191.492499:0:13226:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc900031600/0xaa4c98508c498a5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xaa4c98508c498a64 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788179191.492505:0:13226:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788179191.492508:0:13226:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788179191.492509:0:13226:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788179191.492518:0:13226:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9bc90577f000 00010000:00010000:0.0:1788179191.492520:0:13226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc900031600/0xaa4c98508c498a5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xaa4c98508c498a64 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788179191.492538:0:13226:0:(import.c:65:import_set_state_nolock()) ffff9bc90577f000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788179191.492543:0:13226:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788179191.492545:0:13226:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788179191.492547:0:13226:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788179191.492550:0:13226:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788179191.492561:0:13226:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9bc935a22300 x1875041472042496/t0(0) o250->MGC192.168.202.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788179198 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788179191.492575:0:13226:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788179191.492578:0:13226:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:0.0:1788179191.492605:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:efc6f743-3303-46d5-8807-513b82cac1cc:3304:1875041472042496:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:0.0:1788179191.492629:0:13226:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788179191.492635:0:13226:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c4986f2 00000020:00000080:0.0:1788179191.492640:0:13226:0:(genops.c:907:class_export_put()) final put ffff9bc913609000/efc6f743-3303-46d5-8807-513b82cac1cc 00000020:01000000:0.0:1788179191.492645:0:13226:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.102@tcp (flags='') 00000020:00000080:0.0:1788179191.492655:0:13226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788179191.492660:0:13226:0:(obd_config.c:955:class_cleanup()) MGC192.168.202.102@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788179191.492663:0:13226:0:(genops.c:1587:class_disconnect_exports()) OBD device 2 (ffff9bc9265819c0) has no exports 10000000:01000000:0.0:1788179191.492682:0:5793:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788179191.492737:0:13226:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.202.102@tcp: client import never connected 00000100:00080000:0.0:1788179191.492740:0:13226:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788179191.492742:0:13226:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788179191.492744:0:13226:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788179191.492746:0:13226:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788179191.492777:0:13226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788179191.492781:0:13226:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.102@tcp (uuid efc6f743-3303-46d5-8807-513b82cac1cc) 00000020:01000000:0.0:1788179191.492786:0:13226:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788179191.492789:0:13226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788179191.492792:0:13226:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788179191.492796:0:13226:0:(genops.c:1848:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9bc93b622000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788179191.492801:0:13226:0:(genops.c:1582:class_disconnect_exports()) OBD device 16 (ffff9bc93b678000) has exports, disconnecting them 00000020:00080000:0.0:1788179191.492805:0:13226:0:(genops.c:1557:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9bc93b622000), last request at 1788178992 00000020:00000080:0.0:1788179191.492811:0:13226:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c498929 00000020:00080000:0.0:1788179191.492821:0:13226:0:(genops.c:1562:class_disconnect_export_list()) disconnected export at 0@lo (ffff9bc93b622000): rc 0 00000020:00000080:0.0:1788179191.492824:0:13226:0:(genops.c:907:class_export_put()) final put ffff9bc93b622000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788179191.493474:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc93a96f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788179191.493496:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc913609000/efc6f743-3303-46d5-8807-513b82cac1cc for MGC192.168.202.102@tcp 00000020:00000080:3.0:1788179191.493501:0:36:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9bc90577f000 for MGC192.168.202.102@tcp 00000020:00000080:3.0:1788179191.493506:0:36:0:(genops.c:907:class_export_put()) final put ffff9bc905778800/efc6f743-3303-46d5-8807-513b82cac1cc 00000020:00000080:3.0:1788179191.493508:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc905778800/efc6f743-3303-46d5-8807-513b82cac1cc for MGC192.168.202.102@tcp 00000020:01000000:3.0:1788179191.493513:0:36:0:(genops.c:442:class_free_dev()) finishing cleanup of obd MGC192.168.202.102@tcp (efc6f743-3303-46d5-8807-513b82cac1cc) 00000020:00000080:3.0:1788179191.493742:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc93b622000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788179191.506946:0:13226:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788179191.506955:0:13226:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788179191.506960:0:13226:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788179191.506969:0:13226:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788179191.507105:0:36:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9bc93b620800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1788179191.593640:0:6605:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788179191.593934:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788179191.594062:0:6606:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1788179191.594202:0:5785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:3.0:1788179191.594381:0:5779:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9bc905c43600:5779] 0 exiting: rc = 1 00000100:00100000:3.0:1788179191.594438:0:5780:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9bc905c43000:5780] 1 exiting: rc = 0 00000100:00100000:2.0:1788179191.594535:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.594788:0:5782:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9bc9264a4600:5782] 1 exiting: rc = 0 00000100:00100000:3.0:1788179191.594999:0:5783:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9bc9264a4c00:5783] 2 exiting: rc = 0 00000100:00100000:3.0:1788179191.595052:0:5781:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9bc9264a4200:5781] 0 exiting: rc = 1 00000100:00100000:0.0:1788179191.599258:0:11517:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9bc92e0c8200:11517] 3 exiting: rc = 0 00000100:00100000:2.0:1788179191.599499:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599509:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599515:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599524:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599530:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599535:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599540:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599548:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599554:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599561:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599567:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599573:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599579:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599593:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599599:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599608:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599614:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599620:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599637:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599642:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599647:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599652:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599657:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599662:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599667:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599672:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599676:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599681:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599685:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599690:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599695:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599701:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599706:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599711:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599730:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599735:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599740:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599746:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599751:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599757:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599762:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599767:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599772:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599777:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599782:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599787:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599792:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599798:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599803:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599807:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599812:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599816:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599821:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599826:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599831:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599836:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599841:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599876:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599884:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599889:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599894:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599900:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599905:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.599910:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788179191.600877:0:13226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788179191.600887:0:13226:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788179191.600892:0:13226:0:(genops.c:907:class_export_put()) final put ffff9bc93b627000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788179191.600896:0:13226:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc93b627000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788179191.600902:0:13226:0:(genops.c:442:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1788179191.600950:0:13226:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bc902f11000 1 00000020:00000080:2.0:1788179191.600956:0:13226:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0xaa4c98508c4988ce 00000020:00000080:2.0:1788179191.600964:0:13226:0:(genops.c:907:class_export_put()) final put ffff9bc9359e6800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788179191.600976:0:13226:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788179191.600981:0:13226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788179191.600985:0:13226:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788179191.600988:0:13226:0:(genops.c:1587:class_disconnect_exports()) OBD device 14 (ffff9bc905c23380) has no exports 00000020:00000080:3.0:1788179191.601642:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc9359e6800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788179191.632743:0:13226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788179191.632758:0:13226:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788179191.632763:0:13226:0:(genops.c:907:class_export_put()) final put ffff9bc902f11800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788179191.632767:0:13226:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc902f11800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788179191.632778:0:13226:0:(genops.c:442:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788179191.632972:0:13226:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9bc902f12800 00000020:01000000:2.0:1788179191.632993:0:13226:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788179191.632997:0:13226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788179191.633001:0:13226:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788179191.633005:0:13226:0:(genops.c:1587:class_disconnect_exports()) OBD device 10 (ffff9bc9265c19c0) has no exports 00000020:00000080:2.0:1788179191.633025:0:13226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788179191.633033:0:13226:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788179191.633036:0:13226:0:(genops.c:907:class_export_put()) final put ffff9bc934be2000/OSS_uuid 00000020:00000080:2.0:1788179191.633038:0:13226:0:(genops.c:866:class_export_destroy()) destroying export ffff9bc934be2000/OSS_uuid for OSS 00000020:01000000:2.0:1788179191.633042:0:13226:0:(genops.c:442:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788179191.633111:0:6589:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9bc935966800:6589] 0 exiting: rc = 1 00000100:00080000:1.0:1788179191.634110:0:5792:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788179191.634211:0:7778:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9bc93f730000:7778] 3 exiting: rc = 0 00000100:00100000:1.0:1788179191.634263:0:6591:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9bc9267aa600:6591] 2 exiting: rc = 0 00000100:00100000:1.0:1788179191.634541:0:6590:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9bc90f72c000:6590] 1 exiting: rc = 0 00000100:00100000:2.0:1788179191.634676:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634686:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634691:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634698:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634703:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634709:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634714:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634719:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634724:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634729:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634746:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634752:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634757:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634762:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634767:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634772:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634777:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634783:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634789:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634795:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634801:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634807:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634812:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634817:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634822:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634828:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634832:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634838:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634843:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634873:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634878:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634883:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634887:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634892:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634897:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634901:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634906:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634911:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634916:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634921:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634926:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634930:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634935:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634939:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634944:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634958:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634962:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634967:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634972:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634976:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634981:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634985:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634991:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.634996:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.635002:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.635009:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.635015:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.635019:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.635024:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.635029:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.635034:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.635040:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.635046:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.635052:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788179191.636166:0:6593:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9bc918449e00:6593] 0 exiting: rc = 1 00000100:00100000:0.0:1788179191.636230:0:6594:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9bc926712c00:6594] 1 exiting: rc = 0 00000100:00100000:2.0:1788179191.636385:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636392:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636397:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636402:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636406:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636411:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636416:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636422:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636426:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636430:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636434:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636439:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636443:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636447:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636452:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636457:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636472:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636476:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636482:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636487:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636491:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636496:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636500:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636505:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636509:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636513:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636518:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636522:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636527:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636531:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636536:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636541:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636546:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636551:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636556:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636561:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636566:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636570:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636576:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636581:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636587:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636592:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636596:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636601:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636606:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636611:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636616:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636632:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636639:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636645:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636650:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636664:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636668:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636673:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636679:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636684:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636689:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636694:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636700:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636706:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636712:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636717:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636722:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788179191.636727:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788179191.640105:0:6597:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9bc93ab38000:6597] 2 exiting: rc = 0 00000100:00100000:0.0:1788179191.642130:0:6596:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9bc93ab38400:6596] 1 exiting: rc = 0 00000100:00100000:0.0:1788179191.642327:0:6595:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9bc93ab39800:6595] 0 exiting: rc = 1 00000100:00100000:3.0:1788179191.649474:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649489:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649498:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649504:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649509:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649514:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649520:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649528:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649533:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649538:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649544:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649550:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649557:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649562:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649582:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649588:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649594:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649599:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649605:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649609:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649614:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649619:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649636:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649644:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649668:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649676:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649682:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649688:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649694:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649701:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649707:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649712:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649717:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649723:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649729:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649734:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649740:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649746:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649751:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649757:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649763:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649768:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649773:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649779:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649785:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649789:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649795:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649800:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649820:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649835:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649840:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649845:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649881:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649887:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649893:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649898:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649904:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649910:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649917:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649923:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649928:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649933:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649939:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.649944:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659038:0:6598:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9bc9375c9200:6598] 0 exiting: rc = 1 00000100:00100000:0.0:1788179191.659452:0:6599:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9bc9375c9400:6599] 1 exiting: rc = 0 00000100:00100000:3.0:1788179191.659588:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659596:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659602:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659607:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659612:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659618:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659637:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659642:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659646:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659651:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659656:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659661:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659666:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659671:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659676:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659681:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659686:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659691:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659697:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659715:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659719:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659724:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659729:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659734:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659739:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659744:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659750:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659755:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659760:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659765:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659770:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659775:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659779:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659784:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659789:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659794:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659799:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659805:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659810:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659816:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659821:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659825:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659830:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659835:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659840:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.659845:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.661975:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.661982:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.661987:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.661992:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.661997:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.662002:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.662007:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.662013:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.662036:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.662041:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.662045:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.662050:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.662055:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.662061:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.662066:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.662071:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.662085:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.662091:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.663508:0:6601:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9bc93a554800:6601] 1 exiting: rc = 0 00000100:00100000:1.0:1788179191.665800:0:6600:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9bc9375c9800:6600] 0 exiting: rc = 1 00000100:00100000:3.0:1788179191.670073:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670084:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670105:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670114:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670121:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670126:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670133:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670139:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670144:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670150:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670157:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670163:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670168:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670175:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670180:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670200:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670207:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670212:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670218:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670224:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670230:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670236:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670242:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670248:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670269:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670429:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670440:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670460:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670466:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670471:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670478:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670483:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670488:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670493:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670499:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670505:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670511:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670517:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670523:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670544:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670551:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670556:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670562:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670568:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670576:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670582:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670588:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670593:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670599:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670604:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.670610:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.671222:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.671232:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.671238:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.671244:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.671250:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.671256:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.671261:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.671267:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.671345:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.671351:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.671357:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.671362:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788179191.671380:0:13226:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788179191.691472:0:13226:0:(tgt_mount.c:2258:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788179209.000551:0:13843:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788179216.944567:0:14255:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788179216.944572:0:14255:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788179216.944761:0:14255:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9bc93f796000 00000020:01000004:0.0:1788179216.944775:0:14255:0:(tgt_mount.c:2577:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788179216.944783:0:14255:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788179216.944808:0:14255:0:(genops.c:414:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9bc926584d40) 00000020:00000080:0.0:1788179216.944823:0:14255:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788179216.984551:0:14255:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788179216.995047:0:14255:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1788179216.995817:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 443: rc = 0 00100000:10000000:3.0:1788179216.996082:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 443: rc = 0 00100000:10000000:3.0:1788179216.996188:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 443: rc = 0 00100000:10000000:3.0:1788179216.996279:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 443: rc = 0 00100000:10000000:3.0:1788179216.996501:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 443: rc = 0 00100000:10000000:3.0:1788179216.997026:0:14255:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788179216.997100:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 443: rc = 0 00100000:10000000:3.0:1788179216.997555:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 445: rc = 0 00100000:10000000:3.0:1788179217.001279:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 607: rc = 0 00100000:10000000:3.0:1788179217.001613:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 607: rc = 0 00100000:10000000:3.0:1788179217.002466:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 643: rc = 0 00100000:10000000:3.0:1788179217.003292:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 643: rc = 0 00100000:10000000:3.0:1788179217.003621:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 643: rc = 0 00100000:10000000:3.0:1788179217.004511:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 643: rc = 0 00100000:10000000:3.0:1788179217.005154:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 643: rc = 0 00100000:10000000:3.0:1788179217.006997:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 643: rc = 0 00100000:10000000:3.0:1788179217.007276:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 643: rc = 0 00100000:10000000:3.0:1788179217.007528:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 643: rc = 0 00100000:10000000:3.0:1788179217.007781:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 643: rc = 0 00100000:10000000:3.0:1788179217.008071:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 643: rc = 0 00100000:10000000:3.0:1788179217.008315:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 643: rc = 0 00100000:10000000:3.0:1788179217.008565:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 643: rc = 0 00100000:10000000:3.0:1788179217.008994:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 622: rc = 0 00100000:10000000:3.0:1788179217.009247:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 622: rc = 0 00100000:10000000:3.0:1788179217.009480:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 622: rc = 0 00100000:10000000:3.0:1788179217.009770:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 622: rc = 0 00100000:10000000:3.0:1788179217.010049:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 622: rc = 0 00100000:10000000:3.0:1788179217.016244:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 622: rc = 0 00100000:10000000:2.0:1788179217.022742:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 622: rc = 0 00100000:10000000:2.0:1788179217.023304:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 622: rc = 0 00100000:10000000:2.0:1788179217.026294:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 622: rc = 0 00100000:10000000:2.0:1788179217.029521:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 622: rc = 0 00100000:10000000:2.0:1788179217.029780:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 622: rc = 0 00100000:10000000:2.0:1788179217.036433:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 622: rc = 0 00100000:10000000:2.0:1788179217.037347:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 622: rc = 0 00100000:10000000:2.0:1788179217.040728:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 622: rc = 0 00100000:10000000:2.0:1788179217.041045:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 622: rc = 0 00100000:10000000:2.0:1788179217.041313:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 622: rc = 0 00100000:10000000:2.0:1788179217.041566:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 622: rc = 0 00100000:10000000:2.0:1788179217.042486:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 622: rc = 0 00100000:10000000:2.0:1788179217.042761:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 622: rc = 0 00100000:10000000:2.0:1788179217.043057:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 622: rc = 0 00100000:10000000:2.0:1788179217.045115:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 622: rc = 0 00100000:10000000:2.0:1788179217.047380:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 622: rc = 0 00100000:10000000:2.0:1788179217.047657:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 622: rc = 0 00100000:10000000:2.0:1788179217.049802:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 622: rc = 0 00100000:10000000:3.0:1788179217.056747:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 622: rc = 0 00100000:10000000:3.0:1788179217.057776:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 622: rc = 0 00100000:10000000:3.0:1788179217.058798:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 622: rc = 0 00100000:10000000:3.0:1788179217.059533:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 622: rc = 0 00100000:10000000:3.0:1788179217.060547:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 622: rc = 0 00100000:10000000:3.0:1788179217.061440:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 622: rc = 0 00100000:10000000:3.0:1788179217.061698:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 622: rc = 0 00100000:10000000:3.0:1788179217.062264:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 622: rc = 0 00100000:10000000:3.0:1788179217.062627:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 611: rc = 0 00100000:10000000:3.0:1788179217.063716:0:14255:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788179217.064097:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 608: rc = 0 00100000:10000000:3.0:1788179217.064325:0:14255:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788179217.064389:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 608: rc = 0 00100000:10000000:3.0:1788179217.064582:0:14255:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788179217.064650:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 608: rc = 0 00100000:10000000:3.0:1788179217.065576:0:14255:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788179217.065651:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 640: rc = 0 00100000:10000000:3.0:1788179217.065841:0:14255:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788179217.066228:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 640: rc = 0 00100000:10000000:3.0:1788179217.066536:0:14255:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788179217.066602:0:14255:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 640: rc = 0 00000020:00000080:3.0:1788179217.067561:0:14255:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788179217.067571:0:14255:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788179217.067585:0:14255:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa4c98508c4999fa 00000020:01000004:3.0:1788179217.067593:0:14255:0:(tgt_mount.c:2662:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788179217.067599:0:14255:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788179217.067605:0:14255:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bc93f796000 from MGS 00000020:01000004:3.0:1788179217.067609:0:14255:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788179217.067621:0:14255:0:(genops.c:414:class_newdev()) Allocate new device MGS (ffff9bc9265c0000) 00000020:00000080:3.0:1788179217.067633:0:14255:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788179217.067698:0:14255:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bc93f796000 from MGS, refs=2 00080000:01000000:3.0:1788179217.067703:0:14255:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788179217.067708:0:14255:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa4c98508c499a08 00000100:00100000:3.0:1788179217.067816:0:14255:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788179217.068757:0:14255:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788179217.068765:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788179217.069838:0:14255:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788179217.069879:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788179217.072625:0:14255:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788179217.072800:0:14255:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788179217.072807:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788179217.078199:0:14255:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788179217.078215:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788179217.079221:0:14255:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788179217.079232:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788179217.080113:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179217.080116:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179217.080118:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179217.080479:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179217.080482:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179217.080484:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179217.091831:0:14255:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788179217.101953:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788179217.115789:0:14255:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788179217.115806:0:14255:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788179217.115809:0:14255:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788179217.126556:0:14265:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788179217.126831:0:14255:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788179217.128435:0:14255:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788179217.129004:0:14255:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788179217.130482:0:14255:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788179217.130673:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788179217.130679:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788179217.135052:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788179217.135067:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788179217.138186:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788179217.138210:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788179217.139257:0:14255:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788179217.139294:0:14255:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.102@tcp' 00000020:01000004:3.0:1788179217.139296:0:14255:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788179217.139327:0:14255:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.102@tcp (typ=mgc) 00000020:00000080:3.0:1788179217.139348:0:14255:0:(genops.c:414:class_newdev()) Allocate new device MGC192.168.202.102@tcp (ffff9bc9265c19c0) 00000020:00000080:3.0:1788179217.139365:0:14255:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788179217.139444:0:14255:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bc93fcea000@MGC192.168.202.102@tcp: add connection 192.168.202.102@tcp at head 00010000:00010000:3.0:1788179217.139645:0:14255:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.102@tcp-0 is initialized 00000040:01000000:3.0:1788179217.139651:0:14255:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.102@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788179217.140141:0:14270:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788179217.143008:0:14271:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788179217.143213:0:14255:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.102@tcp (uuid ce136049-9565-40c1-979f-49dcc63d6657) 00000020:00000080:3.0:1788179217.143239:0:14255:0:(genops.c:1407:class_connect()) connect: client ce136049-9565-40c1-979f-49dcc63d6657, cookie 0xaa4c98508c499a16 00000100:00080000:3.0:1788179217.143251:0:14255:0:(import.c:510:import_select_connection()) MGC192.168.202.102@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788179217.143257:0:14255:0:(import.c:624:import_select_connection()) MGC192.168.202.102@tcp: import ffff9bc93fcea000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:3.0:1788179217.143691:0:14255:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bc803619500 x1875041472042752/t0(0) o250->MGC192.168.202.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788179217.143722:0:14255:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ce136049-9565-40c1-979f-49dcc63d6657->MGS 00000020:01000004:3.0:1788179217.143744:0:14255:0:(tgt_mount.c:1875:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788179217.143771:0:14255:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788179217.143786:0:14255:0:(genops.c:414:class_newdev()) Allocate new device MDS (ffff9bc9265c4d40) 00000020:00000080:3.0:1788179217.143798:0:14255:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788179217.144205:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ce136049-9565-40c1-979f-49dcc63d6657:3304:1875041472042752:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788179217.144288:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179217.144696:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472042752 00000100:00100000:3.0:1788179217.144704:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472042752 00000100:00100000:3.0:1788179217.154132:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788179217.154148:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1875041472042752:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788179217.154183:0:14266:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from ce136049-9565-40c1-979f-49dcc63d6657@0@lo t0 exp 0000000000000000 cur 413 last 0 00000020:00000080:3.0:1788179217.154444:0:14266:0:(genops.c:1407:class_connect()) connect: client ce136049-9565-40c1-979f-49dcc63d6657, cookie 0xaa4c98508c499a24 00000100:00080000:3.0:1788179217.154594:0:14266:0:(import.c:65:import_set_state_nolock()) ffff9bc935482000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788179217.154690:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+5:3304:x1875041472042752:12345-0@lo:250:mount.lustre.0 Request processed in 544us (10401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179217.154707:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788179217.154764:0:3304:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.102@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788179217.154773:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.102@tcp: connect to target with instance 0 00000100:00080000:3.0:1788179217.154781:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.102@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788179217.154785:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788179217.154789:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9bc93fcea000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788179217.154791:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788179217.154801:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788179217.154806:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ce136049-9565-40c1-979f-49dcc63d6657:3304:1875041472042752:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788179217.189875:0:14255:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788179217.191326:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788179217.191336:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788179217.192696:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788179217.192708:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788179217.200360:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788179217.200461:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788179217.202775:0:14255:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788179217.203424:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788179217.203430:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788179217.204666:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788179217.204678:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788179217.251394:0:14255:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788179217.251670:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788179217.251677:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788179217.254824:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788179217.254840:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788179217.256413:0:14255:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788179217.256675:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788179217.256681:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788179217.257700:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788179217.257711:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788179217.258812:0:14255:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788179217.259359:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788179217.259365:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788179217.260396:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788179217.260405:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788179217.261427:0:14255:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788179217.261675:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788179217.261680:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788179217.262679:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788179217.262687:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788179217.289451:0:14255:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788179217.290334:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788179217.290342:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788179217.292336:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788179217.292353:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788179217.294513:0:14255:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788179217.294528:0:14255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788179217.295737:0:14255:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788179217.295760:0:14255:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788179217.295767:0:14255:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.102@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788179217.296415:0:14255:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.102@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788179217.296460:0:14255:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.102@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788179217.296465:0:14255:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788179217.296466:0:14255:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788179217.296468:0:14255:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788179217.296469:0:14255:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788179217.296470:0:14255:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788179217.296472:0:14255:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788179217.296473:0:14255:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788179217.296474:0:14255:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788179217.296476:0:14255:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788179217.296477:0:14255:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788179217.296480:0:14255:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788179217.296482:0:14255:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788179217.296483:0:14255:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788179217.296484:0:14255:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788179217.296485:0:14255:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788179217.296486:0:14255:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788179217.296487:0:14255:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788179217.296488:0:14255:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788179217.296489:0:14255:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788179217.296490:0:14255:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788179217.296494:0:14255:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788179217.296518:0:14255:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788179217.296538:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a22300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472042880:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788179217.296676:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179217.296760:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc926545d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788179217.297170:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472042880 00000100:00100000:2.0:1788179217.297178:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472042880 00000100:00100000:2.0:1788179217.297273:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788179217.297282:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+5:14255:x1875041472042880:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788179217.297329:0:14269:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788179217.297331:0:14269:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788179217.297334:0:14269:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788179217.297970:0:14290:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788179217.298687:0:14269:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1788179217.300764:0:14291:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788179217.300959:0:14291:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788179217.300962:0:14291:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788179217.301175:0:14291:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1788179217.301749:0:14269:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788179217.301762:0:14269:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788179217.315665:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+5:14255:x1875041472042880:12345-0@lo:253:mount.lustre.0 Request processed in 18372us (18977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179217.315681:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788179217.316159:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a22300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472042880:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788179217.316180:0:14255:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788179217.316183:0:14255:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788179217.316185:0:14255:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788179217.316186:0:14255:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788179217.316187:0:14255:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788179217.316189:0:14255:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788179217.316190:0:14255:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788179217.316191:0:14255:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788179217.316193:0:14255:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788179217.316194:0:14255:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788179217.316196:0:14255:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788179217.316226:0:14255:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bc93f796000 from lustre-MDT0000 10000000:01000000:0.0:1788179217.316257:0:14255:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788179217.316329:0:14255:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788179217.316334:0:14255:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9bc9265c19c0 10000000:01000000:0.0:1788179217.316339:0:14255:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788179217.316347:0:14255:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9bc9265c19c0 from 1 10000000:01000000:0.0:1788179217.316349:0:14255:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788179217.316386:0:14255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317e400/0xaa4c98508c499a2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179217.316397:0:14255:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc91317e400/0xaa4c98508c499a2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179217.316419:0:14255:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc91317e400/0xaa4c98508c499a2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179217.316439:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a22300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472043008:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788179217.316480:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179217.317045:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc926545480 going to sleep for 11 seconds 00000100:00100000:3.0:1788179217.317331:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472043008 00000100:00100000:3.0:1788179217.317340:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472043008 00000100:00100000:3.0:1788179217.317430:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788179217.317440:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+5:14255:x1875041472043008:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788179217.317458:0:14268:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179217.317479:0:14268:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9137b4a00/0xaa4c98508c499a32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c499a2b expref: -99 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179217.317504:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9137b4a00/0xaa4c98508c499a32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c499a2b expref: 6 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179217.317514:0:14268:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9137b4a00/0xaa4c98508c499a32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c499a2b expref: 6 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179217.317536:0:14268:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4a00, rc 0) 00000100:00100000:3.0:1788179217.317607:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+6:14255:x1875041472043008:12345-0@lo:101:mount.lustre.0 Request processed in 167us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179217.317615:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788179217.317690:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a22300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472043008:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788179217.317706:0:14255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc91317e400/0xaa4c98508c499a2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499a32 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.317715:0:14255:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc91317e400/0xaa4c98508c499a2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c499a32 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179217.317788:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803600000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472043136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788179217.317830:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179217.318559:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9340579c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788179217.318709:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472043136 00000100:00100000:0.0:1788179217.318717:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472043136 00000100:00100000:0.0:1788179217.318756:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788179217.319154:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+6:14255:x1875041472043136:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788179217.320371:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+6:14255:x1875041472043136:12345-0@lo:501:mount.lustre.0 Request processed in 1214us (2534us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788179217.320382:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788179217.320463:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803600000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472043136:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788179217.320501:0:14255:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788179217.320613:0:14255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317e400/0xaa4c98508c499a2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499a32 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.320624:0:14255:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc91317e400/0xaa4c98508c499a2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499a32 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788179217.320633:0:14255:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bc93f796000 10000000:01000000:1.0:1788179217.320638:0:14255:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788179217.320643:0:14255:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9bc93f796000 10000000:01000000:1.0:1788179217.320646:0:14255:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788179217.320649:0:14255:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9bc93f796000 from 1 10000000:01000000:1.0:1788179217.320651:0:14255:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788179217.320687:0:14255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc942173800/0xaa4c98508c499a39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.320695:0:14255:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc942173800/0xaa4c98508c499a39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.320704:0:14255:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc942173800/0xaa4c98508c499a39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179217.320722:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803600000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472043264:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788179217.320757:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179217.321253:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9340579c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788179217.321415:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472043264 00000100:00100000:2.0:1788179217.321422:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472043264 00000100:00100000:2.0:1788179217.321501:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788179217.321510:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+6:14255:x1875041472043264:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788179217.321523:0:14268:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179217.321540:0:14268:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9136c4e00/0xaa4c98508c499a40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c499a39 expref: -99 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179217.321658:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9136c4e00/0xaa4c98508c499a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c499a39 expref: 7 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179217.321668:0:14268:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9136c4e00/0xaa4c98508c499a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c499a39 expref: 7 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179217.321677:0:14268:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c4e00, rc 0) 00000100:00100000:2.0:1788179217.321733:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+7:14255:x1875041472043264:12345-0@lo:101:mount.lustre.0 Request processed in 223us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179217.321740:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788179217.321834:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803600000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472043264:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788179217.322216:0:14255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc942173800/0xaa4c98508c499a39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499a40 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.322236:0:14255:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc942173800/0xaa4c98508c499a39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c499a40 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788179217.322255:0:14255:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788179217.322283:0:14255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc942173800/0xaa4c98508c499a39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499a40 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.322292:0:14255:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc942173800/0xaa4c98508c499a39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499a40 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788179217.322300:0:14255:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788179217.322305:0:14255:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788179217.322311:0:14255:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9bc93f796000 10000000:01000000:1.0:1788179217.322313:0:14255:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788179217.322318:0:14255:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788179217.322321:0:14255:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788179217.322346:0:14255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc942172e00/0xaa4c98508c499a47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.322354:0:14255:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc942172e00/0xaa4c98508c499a47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.322362:0:14255:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc942172e00/0xaa4c98508c499a47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179217.322379:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803600000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472043392:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788179217.322418:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179217.323698:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472043392 00000100:00100000:3.0:1788179217.323711:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472043392 00000100:00100000:3.0:1788179217.323767:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788179217.323777:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+7:14255:x1875041472043392:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788179217.323794:0:14269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179217.323811:0:14269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9137b5000/0xaa4c98508c499a4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c499a47 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179217.323839:0:14269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9137b5000/0xaa4c98508c499a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c499a47 expref: 8 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179217.323863:0:14269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9137b5000/0xaa4c98508c499a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c499a47 expref: 8 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179217.323872:0:14269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b5000, rc 0) 00000100:00100000:3.0:1788179217.323921:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+8:14255:x1875041472043392:12345-0@lo:101:mount.lustre.0 Request processed in 145us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179217.323927:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788179217.324242:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9340579c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788179217.324349:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803600000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472043392:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788179217.324366:0:14255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc942172e00/0xaa4c98508c499a47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499a4e expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.324376:0:14255:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc942172e00/0xaa4c98508c499a47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c499a4e expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179217.324446:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803600000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472043520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788179217.324477:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179217.324502:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9340579c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788179217.324672:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472043520 00000100:00100000:3.0:1788179217.324677:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472043520 00000100:00100000:3.0:1788179217.324699:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788179217.324706:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+8:14255:x1875041472043520:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788179217.326335:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+9:14255:x1875041472043520:12345-0@lo:501:mount.lustre.0 Request processed in 1623us (1851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179217.326353:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788179217.326638:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803600000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472043520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788179217.326687:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803600000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472043648:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788179217.326734:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179217.326778:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9340579c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788179217.326998:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472043648 00000100:00100000:3.0:1788179217.327004:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472043648 00000100:00100000:3.0:1788179217.327188:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788179217.327197:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+9:14255:x1875041472043648:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788179217.327724:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+9:14255:x1875041472043648:12345-0@lo:503:mount.lustre.0 Request processed in 526us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179217.327732:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788179217.327824:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803600000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472043648:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788179217.329480:0:14292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a20e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce136049-9565-40c1-979f-49dcc63d6657:14292:1875041472043776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788179217.329634:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179217.329680:0:14292:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc926545900 going to sleep for 11 seconds 00000100:00100000:2.0:1788179217.329733:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472043776 00000100:00100000:2.0:1788179217.329741:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472043776 00000100:00100000:2.0:1788179217.329795:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788179217.329804:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+9:14292:x1875041472043776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788179217.330699:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+9:14292:x1875041472043776:12345-0@lo:502:llog_process_th.0 Request processed in 894us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179217.330709:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788179217.331012:0:14292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a20e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce136049-9565-40c1-979f-49dcc63d6657:14292:1875041472043776:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788179217.331333:0:14292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788179217.331346:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788179217.331348:0:14292:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788179217.331354:0:14292:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788179217.331357:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788179217.331374:0:14292:0:(genops.c:414:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9bc9265819c0) 00000020:00000080:0.0:1788179217.331398:0:14292:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788179217.331405:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788179217.331477:0:14292:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788179217.331490:0:14292:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa4c98508c499a5c 00000020:00000080:0.0:1788179217.332419:0:14292:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788179217.332426:0:14292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788179217.332432:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788179217.332434:0:14292:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788179217.332436:0:14292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788179217.332440:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788179217.332442:0:14292:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788179217.332445:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788179217.332454:0:14292:0:(genops.c:414:class_newdev()) Allocate new device lustre-MDT0000 (ffff9bc926583380) 00000020:00000080:0.0:1788179217.332468:0:14292:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788179217.332472:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788179217.332474:0:14292:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788179217.332477:0:14292:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788179217.332484:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788179217.332656:0:14292:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bc93f796000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788179217.332671:0:14292:0:(genops.c:414:class_newdev()) Allocate new device lustre-MDD0000 (ffff9bc926580000) 00000020:00000080:0.0:1788179217.332679:0:14292:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788179217.332725:0:14292:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788179217.332730:0:14292:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa4c98508c499a71 00000020:00000080:0.0:1788179217.333475:0:14292:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788179217.333484:0:14292:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788179217.333491:0:14292:0:(genops.c:1407:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xaa4c98508c499a78 00080000:01000000:0.0:1788179217.333497:0:14292:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788179217.333502:0:14292:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa4c98508c499a7f 00010000:00010000:0.0:1788179217.427441:0:14292:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788179217.428519:0:14292:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1788179217.429212:0:14292:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788179217.430734:0:14292:0:(genops.c:414:class_newdev()) Allocate new device lustre-QMT0000 (ffff9bc93b678000) 00000020:00000080:2.0:1788179217.430948:0:14292:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788179217.431741:0:14292:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788179217.431752:0:14292:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa4c98508c499a8d 00000020:00000080:3.0:1788179217.435405:0:14292:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788179217.446927:0:14292:0:(genops.c:1407:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xaa4c98508c499a94 00000020:00000080:2.0:1788179217.452338:0:14292:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788179217.452353:0:14292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788179217.452361:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788179217.452363:0:14292:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788179217.452377:0:14292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788179217.452380:0:14292:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788179217.452381:0:14292:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788179217.452383:0:14292:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788179217.452385:0:14292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788179217.452387:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788179217.452389:0:14292:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788179217.452391:0:14292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788179217.452396:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788179217.452397:0:14292:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788179217.452402:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788179217.452456:0:14292:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788179217.452474:0:14292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788179217.452478:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788179217.452479:0:14292:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788179217.452482:0:14292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788179217.452486:0:14292:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788179217.452489:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788179217.452490:0:14292:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788179217.452493:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788179217.452499:0:14292:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.102@tcp to nid 0x20000c0a8ca66 (192.168.202.102@tcp) 00000020:01000000:2.0:1788179217.452529:0:14292:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788179217.452532:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788179217.452560:0:14292:0:(genops.c:414:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9bc93b67cd40) 00000020:00000080:2.0:1788179217.452579:0:14292:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788179217.452585:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788179217.452640:0:14292:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788179217.452645:0:14292:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788179217.452652:0:14292:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa4c98508c499aa2 00010000:00080000:2.0:1788179217.452683:0:14292:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bc910ed8000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.102@tcp at head 00010000:00010000:2.0:1788179217.453569:0:14292:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788179217.454433:0:14292:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788179217.454489:0:14292:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788179217.459316:0:14292:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788179217.459386:0:14292:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788179217.459467:0:14292:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000020:00000080:0.0:1788179217.463492:0:14292:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788179217.463507:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788179217.463550:0:14292:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788179217.463571:0:14292:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa4c98508c499aa9 00000100:00080000:0.0:1788179217.463584:0:14292:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788179217.463590:0:14292:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bc910ed8000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:0.0:1788179217.463629:0:14292:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bc935a20e00 x1875041472043904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788179217.463669:0:14292:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788179217.463739:0:14292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788179217.463742:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788179217.463744:0:14292:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788179217.463747:0:14292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788179217.463750:0:14292:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1788179217.463752:0:14292:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788179217.463753:0:14292:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788179217.463755:0:14292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788179217.463757:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788179217.463758:0:14292:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788179217.463760:0:14292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788179217.463764:0:14292:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788179217.463767:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788179217.463768:0:14292:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788179217.463771:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788179217.463774:0:14292:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.102@tcp to nid 0x20000c0a8ca66 (192.168.202.102@tcp) 00000020:01000000:0.0:1788179217.463800:0:14292:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788179217.463802:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788179217.463813:0:14292:0:(genops.c:414:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9bc93abc4d40) 00000020:00000080:0.0:1788179217.463824:0:14292:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788179217.463828:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1788179217.464067:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875041472043904:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788179217.464173:0:3304:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875041472043904 offset 0 length 520: 4 00000004:00080000:0.0:1788179217.464783:0:14292:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788179217.464790:0:14292:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788179217.464798:0:14292:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xaa4c98508c499ab7 00010000:00080000:0.0:1788179217.464833:0:14292:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bc910edd000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.102@tcp at head 00000040:00080000:2.0:1788179217.465013:0:14296:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788179217.465018:0:14296:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00010000:00010000:2.0:1788179217.466013:0:14292:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788179217.466463:0:14292:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788179217.466489:0:14292:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788179217.469710:0:14292:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788179217.470185:0:14292:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788179217.470357:0:14292:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788179217.471374:0:14298:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788179217.471382:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788179217.473796:0:14292:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788179217.473812:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788179217.473880:0:14292:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788179217.473903:0:14292:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa4c98508c499abe 00000100:00080000:1.0:1788179217.473915:0:14292:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788179217.473920:0:14292:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bc910edd000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:1.0:1788179217.473955:0:14292:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bc803600000 x1875041472044032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788179217.474000:0:14292:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788179217.474073:0:14292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:3.0:1788179217.475073:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875041472044032:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788179217.475156:0:3304:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875041472044032 offset 0 length 520: 4 00000020:00000080:1.0:1788179217.475461:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788179217.475464:0:14292:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788179217.475474:0:14292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788179217.475479:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788179217.475481:0:14292:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788179217.475484:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788179217.475486:0:14292:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788179217.475488:0:14292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788179217.475491:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788179217.475492:0:14292:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788179217.475494:0:14292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788179217.475497:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788179217.475498:0:14292:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788179217.475502:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788179217.475609:0:14292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce136049-9565-40c1-979f-49dcc63d6657:14292:1875041472044160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788179217.475666:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179217.475728:0:14292:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc934057240 going to sleep for 11 seconds 00000100:00100000:2.0:1788179217.477627:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472044160 00000100:00100000:2.0:1788179217.477641:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472044160 00000100:00100000:2.0:1788179217.477695:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788179217.477704:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc926561050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+9:14292:x1875041472044160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788179217.478343:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc926561050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+9:14292:x1875041472044160:12345-0@lo:502:llog_process_th.0 Request processed in 638us (2674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179217.478351:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788179217.478573:0:14292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce136049-9565-40c1-979f-49dcc63d6657:14292:1875041472044160:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788179217.478606:0:14292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788179217.478613:0:14292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788179217.478615:0:14292:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788179217.478619:0:14292:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788179217.478880:0:14255:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1788179217.478901:0:14255:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788179217.478922:0:14255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc942172e00/0xaa4c98508c499a47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499a4e expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179217.478935:0:14255:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc942172e00/0xaa4c98508c499a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499a4e expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788179217.478944:0:14255:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9bc93f796000 from 1 10000000:01000000:3.0:1788179217.478947:0:14255:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788179217.478984:0:14255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499ac5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179217.478992:0:14255:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499ac5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179217.479013:0:14255:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499ac5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179217.479044:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803619500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472044288:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788179217.479318:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179217.479352:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc907091e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788179217.479405:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472044288 00000100:00100000:0.0:1788179217.479412:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472044288 00000100:00100000:0.0:1788179217.479446:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788179217.479453:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc926562050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+9:14255:x1875041472044288:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788179217.479471:0:14269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179217.479486:0:14269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c499acc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c499ac5 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179217.479508:0:14269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c499acc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c499ac5 expref: 10 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179217.479517:0:14269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c499acc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c499ac5 expref: 10 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179217.479526:0:14269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317fc00, rc 0) 00000100:00100000:0.0:1788179217.479567:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc926562050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+10:14255:x1875041472044288:12345-0@lo:101:mount.lustre.0 Request processed in 114us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179217.479573:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788179217.480620:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803619500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472044288:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788179217.480641:0:14255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499ac5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499acc expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.480652:0:14255:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499ac5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c499acc expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179217.482333:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472044416:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788179217.482408:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179217.482490:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc934057240 going to sleep for 11 seconds 00000100:00100000:2.0:1788179217.490467:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472044416 00000100:00100000:2.0:1788179217.490488:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472044416 00000100:00100000:2.0:1788179217.491210:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788179217.491225:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc926563c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+10:14255:x1875041472044416:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788179217.491613:0:14268:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788179217.491627:0:14268:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788179217.492808:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc926563c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+10:14255:x1875041472044416:12345-0@lo:256:mount.lustre.0 Request processed in 1582us (10394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179217.492821:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788179217.493468:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472044416:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788179217.498648:0:14255:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788179217.498675:0:14255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499ac5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499acc expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.498687:0:14255:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499ac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499acc expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788179217.498696:0:14255:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bc93f796000 from 1 10000000:01000000:1.0:1788179217.498700:0:14255:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788179217.498742:0:14255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c499ad3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.498749:0:14255:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c499ad3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.498760:0:14255:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c499ad3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179217.498784:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472044544:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788179217.499218:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179217.499383:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc934057240 going to sleep for 11 seconds 00000100:00100000:3.0:1788179217.500227:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472044544 00000100:00100000:3.0:1788179217.500237:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472044544 00000100:00100000:3.0:1788179217.500428:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788179217.500439:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc926561450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+10:14255:x1875041472044544:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788179217.500455:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179217.500472:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9137b4200/0xaa4c98508c499ada lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c499ad3 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179217.500500:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9137b4200/0xaa4c98508c499ada lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c499ad3 expref: 11 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179217.500512:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9137b4200/0xaa4c98508c499ada lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c499ad3 expref: 11 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179217.500522:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4200, rc 0) 00000100:00100000:3.0:1788179217.501214:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc926561450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+11:14255:x1875041472044544:12345-0@lo:101:mount.lustre.0 Request processed in 773us (1993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179217.501224:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788179217.501517:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472044544:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788179217.501557:0:14255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c499ad3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499ada expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.501569:0:14255:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c499ad3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c499ada expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179217.501641:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472044672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788179217.501681:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179217.501726:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc934057240 going to sleep for 11 seconds 00000100:00100000:2.0:1788179217.502045:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472044672 00000100:00100000:2.0:1788179217.502052:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472044672 00000100:00100000:2.0:1788179217.502093:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788179217.502109:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc926561850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+12:14255:x1875041472044672:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788179217.502535:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc926561850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+12:14255:x1875041472044672:12345-0@lo:501:mount.lustre.0 Request processed in 426us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179217.502553:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788179217.503393:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472044672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788179217.503452:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472044800:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788179217.503506:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179217.503534:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc934057240 going to sleep for 11 seconds 00000100:00100000:3.0:1788179217.504384:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472044800 00000100:00100000:3.0:1788179217.504395:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472044800 00000100:00100000:3.0:1788179217.504439:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788179217.504449:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e79dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+11:14255:x1875041472044800:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788179217.507538:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e79dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+11:14255:x1875041472044800:12345-0@lo:503:mount.lustre.0 Request processed in 3081us (4022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179217.507562:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788179217.511971:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472044800:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788179217.513908:0:14300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc80361ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce136049-9565-40c1-979f-49dcc63d6657:14300:1875041472044928:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788179217.513988:0:14300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179217.514046:0:14300:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc907091240 going to sleep for 11 seconds 00000100:00100000:0.0:1788179217.514290:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472044928 00000100:00100000:0.0:1788179217.514298:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472044928 00000100:00100000:0.0:1788179217.514348:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788179217.514357:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e79f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+11:14300:x1875041472044928:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788179217.514661:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e79f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+11:14300:x1875041472044928:12345-0@lo:502:llog_process_th.0 Request processed in 304us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179217.514669:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788179217.515234:0:14300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc80361ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce136049-9565-40c1-979f-49dcc63d6657:14300:1875041472044928:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788179217.515473:0:14300:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788179217.515484:0:14300:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788179217.515487:0:14300:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788179217.515496:0:14300:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bc93f796000 00000020:00000080:3.0:1788179217.515500:0:14300:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788179217.515509:0:14300:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788179217.515512:0:14300:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788179217.515513:0:14300:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788179217.515516:0:14300:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788179217.515518:0:14300:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788179217.515520:0:14300:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788179217.515523:0:14300:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bc93f796000 00000020:00000080:3.0:1788179217.515525:0:14300:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788179217.515609:0:14300:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788179217.515612:0:14300:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788179217.515614:0:14300:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788179217.515617:0:14300:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788179217.515619:0:14300:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788179217.515620:0:14300:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788179217.515634:0:14300:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bc93f796000 00000020:00000080:3.0:1788179217.515636:0:14300:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788179217.515685:0:14300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc80361ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce136049-9565-40c1-979f-49dcc63d6657:14300:1875041472045056:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788179217.515737:0:14300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179217.515789:0:14300:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc907091240 going to sleep for 11 seconds 00000100:00100000:0.0:1788179217.517537:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472045056 00000100:00100000:0.0:1788179217.517560:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472045056 00000100:00100000:0.0:1788179217.517618:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788179217.517628:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e79cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+11:14300:x1875041472045056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788179217.518959:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e79cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+11:14300:x1875041472045056:12345-0@lo:502:llog_process_th.0 Request processed in 1327us (3216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179217.518977:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788179217.533884:0:14300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc80361ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce136049-9565-40c1-979f-49dcc63d6657:14300:1875041472045056:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788179217.533935:0:14300:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788179217.533947:0:14300:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788179217.533950:0:14300:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788179217.533955:0:14300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788179217.534685:0:14255:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788179217.534720:0:14255:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788179217.534736:0:14255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c499ad3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499ada expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179217.534748:0:14255:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c499ad3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499ada expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788179217.534806:0:14255:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788179217.534810:0:14255:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bc93f796000 10000000:01000000:2.0:1788179217.534813:0:14255:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bc93f796000 10000000:01000000:2.0:1788179217.534817:0:14255:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788179217.534824:0:14255:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9bc93f796000 from 1 10000000:01000000:2.0:1788179217.534827:0:14255:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788179217.534890:0:14255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4400/0xaa4c98508c499ae1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179217.534900:0:14255:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4400/0xaa4c98508c499ae1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179217.534910:0:14255:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4400/0xaa4c98508c499ae1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179217.534931:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc907039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472045184:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788179217.534995:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179217.535626:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9266da9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788179217.535708:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472045184 00000100:00100000:1.0:1788179217.535715:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472045184 00000100:00100000:1.0:1788179217.535773:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788179217.535783:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e79d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+11:14255:x1875041472045184:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788179217.535797:0:14268:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179217.535813:0:14268:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc942173000/0xaa4c98508c499ae8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c499ae1 expref: -99 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.535865:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc942173000/0xaa4c98508c499ae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c499ae1 expref: 12 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.535876:0:14268:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc942173000/0xaa4c98508c499ae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c499ae1 expref: 12 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.535885:0:14268:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc942173000, rc 0) 00000100:00100000:1.0:1788179217.535934:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e79d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+12:14255:x1875041472045184:12345-0@lo:101:mount.lustre.0 Request processed in 153us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179217.535941:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788179217.535987:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc907039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472045184:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788179217.536001:0:14255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4400/0xaa4c98508c499ae1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499ae8 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.536010:0:14255:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4400/0xaa4c98508c499ae1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c499ae8 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179217.537666:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472045312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788179217.537739:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179217.537777:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc934057cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788179217.537986:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472045312 00000100:00100000:0.0:1788179217.537994:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472045312 00000100:00100000:0.0:1788179217.538045:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788179217.538055:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e79e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+12:14255:x1875041472045312:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788179217.538343:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e79e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+12:14255:x1875041472045312:12345-0@lo:501:mount.lustre.0 Request processed in 289us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179217.538350:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788179217.538913:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472045312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788179217.538966:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472045440:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788179217.539014:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179217.539053:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc934057cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788179217.539683:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472045440 00000100:00100000:2.0:1788179217.539691:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472045440 00000100:00100000:2.0:1788179217.539735:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788179217.539744:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e79d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+12:14255:x1875041472045440:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788179217.539971:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e79d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+12:14255:x1875041472045440:12345-0@lo:503:mount.lustre.0 Request processed in 227us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179217.539979:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788179217.540752:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472045440:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788179217.560211:0:14303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a23480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce136049-9565-40c1-979f-49dcc63d6657:14303:1875041472045568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788179217.560312:0:14303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179217.560361:0:14303:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc918518600 going to sleep for 11 seconds 00000100:00100000:2.0:1788179217.561223:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472045568 00000100:00100000:2.0:1788179217.561236:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472045568 00000100:00100000:2.0:1788179217.561302:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788179217.561313:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e79f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+12:14303:x1875041472045568:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788179217.561826:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e79f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+12:14303:x1875041472045568:12345-0@lo:502:llog_process_th.0 Request processed in 511us (1510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179217.561835:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788179217.562686:0:14303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a23480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce136049-9565-40c1-979f-49dcc63d6657:14303:1875041472045568:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788179217.562759:0:14303:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788179217.562777:0:14303:0:(genops.c:414:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9bc93abc3380) 00000020:00000080:0.0:1788179217.562798:0:14303:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788179217.563043:0:14303:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bc93f796000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788179217.563047:0:14303:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bc93f796000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788179217.563050:0:14303:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bc93f796000 4 00010000:00080000:0.0:1788179217.563087:0:14303:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bc910475000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.102@tcp at head 00010000:00010000:0.0:1788179217.564889:0:14303:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788179217.565012:0:14303:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788179217.565050:0:14303:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788179217.565065:0:14303:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xaa4c98508c499af6 00000100:00080000:0.0:1788179217.565076:0:14303:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788179217.565081:0:14303:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9bc910475000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:0.0:1788179217.565133:0:14303:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bc935a23480 x1875041472045696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788179217.565185:0:14303:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788179217.572473:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875041472045696:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788179217.573330:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179217.573435:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472045696 00000100:00100000:2.0:1788179217.573444:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472045696 00000100:00100000:2.0:1788179217.573487:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788179217.573495:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875041472045696:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788179217.574025:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875041472045696:12345-0@lo:38:llog_process_th.0 Request processed in 527us (765us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788179217.574360:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788179217.574406:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788179217.574414:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9bc910475000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788179217.574418:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788179217.574429:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875041472045696:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788179217.575505:0:14303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a21f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce136049-9565-40c1-979f-49dcc63d6657:14303:1875041472045824:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788179217.575597:0:14303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179217.575654:0:14303:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc918518600 going to sleep for 11 seconds 00000100:00100000:2.0:1788179217.578912:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472045824 00000100:00100000:2.0:1788179217.578934:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472045824 00000100:00100000:2.0:1788179217.579010:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788179217.579023:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e79f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+12:14303:x1875041472045824:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788179217.580646:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e79f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+12:14303:x1875041472045824:12345-0@lo:502:llog_process_th.0 Request processed in 1619us (5042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179217.580659:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788179217.582097:0:14303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a21f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce136049-9565-40c1-979f-49dcc63d6657:14303:1875041472045824:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788179217.582160:0:14303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788179217.582265:0:14255:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788179217.582297:0:14255:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788179217.582313:0:14255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4400/0xaa4c98508c499ae1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499ae8 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179217.582324:0:14255:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc9136c4400/0xaa4c98508c499ae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499ae8 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788179217.582370:0:14255:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788179217.582373:0:14255:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788179217.582374:0:14255:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788179217.582375:0:14255:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788179217.582377:0:14255:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788179217.582378:0:14255:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788179217.582380:0:14255:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788179217.582381:0:14255:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788179217.582383:0:14255:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788179217.582385:0:14255:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788179217.582388:0:14255:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788179217.582390:0:14255:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788179217.582392:0:14255:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788179217.582393:0:14255:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788179217.582394:0:14255:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788179217.582395:0:14255:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788179217.582397:0:14255:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788179217.582403:0:14255:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788179217.582404:0:14255:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788179217.582405:0:14255:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788179217.582405:0:14255:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788179217.582440:0:14255:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788179217.582459:0:14255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a21f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472045952:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788179217.582521:0:14255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179217.583194:0:14255:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc918518600 going to sleep for 11 seconds 00000100:00100000:2.0:1788179217.591838:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472045952 00000100:00100000:2.0:1788179217.591877:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472045952 00000100:00100000:3.0:1788179217.598774:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788179217.598793:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e79c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+12:14255:x1875041472045952:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788179217.598905:0:14269:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788179217.598923:0:14269:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788179217.644709:0:14269:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788179217.644735:0:14269:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788179217.644757:0:14290:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788179217.644761:0:14290:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788179217.644784:0:14290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499afd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.644802:0:14290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c499acc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c499ac5 expref: 12 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.644811:0:14290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499afd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.644870:0:14290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c499acc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c499ac5 expref: 12 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.644886:0:14290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c499acc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c499ac5 expref: 12 pid: 14269 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179217.644900:0:14290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14290:1875041472046080:0@lo:104: 00000100:00100000:1.0:1788179217.644965:0:14290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179217.645004:0:14290:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc920e560c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788179217.645054:0:14256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472046080 00000100:00100000:1.0:1788179217.645062:0:14256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472046080 00000100:00100000:1.0:1788179217.645100:0:14256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788179217.645108:0:14256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803602680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce136049-9565-40c1-979f-49dcc63d6657+3:14290:x1875041472046080:12345-0@lo:104: 00010000:00010000:1.0:1788179217.645132:0:14256:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499ac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c499acc expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.645183:0:14256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788179217.645200:0:14256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803602680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce136049-9565-40c1-979f-49dcc63d6657+3:14290:x1875041472046080:12345-0@lo:104: Request processed in 92us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179217.645207:0:14256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788179217.645233:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788179217.645239:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499ac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c499acc expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.645247:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5e00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:1.0:1788179217.645251:0:14262:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499ac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c499acc expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.645259:0:14262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499ac5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c499acc expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788179217.645265:0:14262:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499ac5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c499acc expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788179217.645271:0:14262:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788179217.645297:0:14262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499ac5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c499acc expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.645304:0:14262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788179217.645324:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499ac5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c499acc expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.645333:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499ac5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c499acc expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.645347:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179217.645349:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179217.645350:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179217.645385:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce136049-9565-40c1-979f-49dcc63d6657:3308:1875041472046208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788179217.645417:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179217.645531:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472046208 00000100:00100000:1.0:1788179217.645535:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472046208 00010000:00010000:1.0:1788179217.645552:0:14258:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c499acc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c499ac5 expref: 13 pid: 14269 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179217.645573:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788179217.645578:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803603100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce136049-9565-40c1-979f-49dcc63d6657+13:3308:x1875041472046208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788179217.645587:0:14258:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788179217.645592:0:14258:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c499acc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c499ac5 expref: 13 pid: 14269 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.645601:0:14258:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c499acc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c499ac5 expref: 13 pid: 14269 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.645619:0:14258:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499afd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.645627:0:14258:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499afd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788179217.645639:0:14258:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000879042s 00010000:00010000:1.0:1788179217.645643:0:14258:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499afd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.645649:0:14258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499afd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.645655:0:14258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499afd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.645670:0:14258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499afd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.645676:0:14258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc942173c00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:1.0:1788179217.645680:0:14258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499afd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.645687:0:14258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499afd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.645695:0:14258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499afd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.645706:0:14258:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788179217.645737:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803603100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce136049-9565-40c1-979f-49dcc63d6657+13:3308:x1875041472046208:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179217.645746:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788179217.645785:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce136049-9565-40c1-979f-49dcc63d6657:3308:1875041472046208:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788179217.645811:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc91317fc00/0xaa4c98508c499acc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c499ac5 expref: 12 pid: 14269 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179217.645821:0:14290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14290:1875041472046080:0@lo:104: 00010000:00010000:1.0:1788179217.645832:0:14290:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499afd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.645842:0:14290:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499afd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.645888:0:14290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499afd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179217.645894:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499afd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179217.652994:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e79c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+11:14255:x1875041472045952:12345-0@lo:253:mount.lustre.0 Request processed in 54196us (70463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179217.653011:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788179217.653044:0:14255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a21f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14255:1875041472045952:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788179217.653062:0:14255:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788179217.653065:0:14255:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788179217.653067:0:14255:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788179217.653069:0:14255:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788179217.653070:0:14255:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788179217.653071:0:14255:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788179217.653072:0:14255:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788179217.653074:0:14255:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788179217.653075:0:14255:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788179217.653077:0:14255:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788179217.653079:0:14255:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788179217.653104:0:14255:0:(tgt_mount.c:2766:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788179217.659681:0:14255:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788179217.661422:0:14255:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788179217.663332:0:14255:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788179217.663622:0:14255:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788179217.665903:0:14255:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788179217.666104:0:14255:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788179217.667536:0:14255:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788179217.667718:0:14255:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788179217.668154:0:14255:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788179217.668389:0:14255:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788179217.669142:0:14255:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788179217.669309:0:14255:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788179217.695715:0:14255:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788179217.696092:0:14255:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788179217.696182:0:14311:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788179217.696186:0:14311:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788179217.696505:0:14312:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1788179217.696576:0:14312:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788179217.701904:0:14312:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788179217.701993:0:14312:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788179217.701998:0:14312:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1788179217.702679:0:14255:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788179217.702815:0:14255:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788179217.703683:0:14255:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788179217.703984:0:14255:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788179217.704284:0:14255:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788179217.706155:0:14255:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788179217.707019:0:14255:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788179217.707065:0:14255:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1788179217.709034:0:14255:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1788179217.714480:0:14255:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788179217.757141:0:14255:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788179217.757181:0:14255:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4e20188f988 00100000:10000000:2.0:1788179217.757190:0:14255:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788179217.757837:0:14255:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788179217.757867:0:14255:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.102@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788179217.757884:0:14255:0:(tgt_mount.c:2535:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788179217.757903:0:14255:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788179218.113796:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788179218.625978:0:14308:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788179219.074826:0:14271:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788179219.074878:0:14271:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9bc93f796000 from 6 10000000:01000000:0.0:1788179219.074883:0:14271:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788179219.074931:0:14271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317f200/0xaa4c98508c499b04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179219.074944:0:14271:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc91317f200/0xaa4c98508c499b04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179219.074955:0:14271:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc91317f200/0xaa4c98508c499b04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179219.074982:0:14271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a21f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472046336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788179219.075047:0:14271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179219.075164:0:14271:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc935394f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788179219.083140:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472046336 00000100:00100000:2.0:1788179219.083154:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472046336 00000100:00100000:2.0:1788179219.083226:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788179219.083237:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e79c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+11:14271:x1875041472046336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788179219.083256:0:14268:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179219.083277:0:14268:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9136c5e00/0xaa4c98508c499b0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c499b04 expref: -99 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179219.083306:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9136c5e00/0xaa4c98508c499b0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c499b04 expref: 12 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179219.083317:0:14268:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9136c5e00/0xaa4c98508c499b0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c499b04 expref: 12 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179219.083327:0:14268:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c5e00, rc 0) 00000100:00100000:2.0:1788179219.083415:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e79c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+12:14271:x1875041472046336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (8366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179219.083423:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788179219.083500:0:14271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a21f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472046336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788179219.083519:0:14271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc91317f200/0xaa4c98508c499b04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499b0b expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179219.083529:0:14271:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc91317f200/0xaa4c98508c499b04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c499b0b expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179219.083626:0:14271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc907038000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472046464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788179219.083669:0:14271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179219.083696:0:14271:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc910ebe000 going to sleep for 11 seconds 00000100:00100000:3.0:1788179219.083938:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472046464 00000100:00100000:3.0:1788179219.083944:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472046464 00000100:00100000:3.0:1788179219.083976:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788179219.083984:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e79d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+12:14271:x1875041472046464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788179219.084000:0:14266:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788179219.084031:0:14266:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788179219.084034:0:14266:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788179219.084135:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e79d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+12:14271:x1875041472046464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 151us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179219.084142:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788179219.084181:0:14271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc907038000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472046464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788179219.084228:0:14271:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788179219.084236:0:14271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317f200/0xaa4c98508c499b04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499b0b expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179219.084244:0:14271:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc91317f200/0xaa4c98508c499b04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499b0b expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179219.136053:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788179219.652292:0:14308:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788179220.163563:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179221.184217:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179222.209308:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788179222.678251:0:14554:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1788179222.721530:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788179222.721538:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788179222.721540:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788179222.721543:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788179222.721546:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788179222.721549:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788179222.721553:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bc910475000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788179222.721565:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9bc910475000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:3.0:1788179222.721588:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bc80361aa00 x1875041472046720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788179222.721668:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce136049-9565-40c1-979f-49dcc63d6657:3305:1875041472046592:0@lo:400:kworker.0 00000100:00100000:2.0:1788179222.721750:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179222.721822:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc80361aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875041472046720:0@lo:38:kworker.0 00000100:00100000:2.0:1788179222.721872:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179222.721915:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472046720 00000100:00100000:2.0:1788179222.721922:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472046720 00000100:00100000:2.0:1788179222.721966:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788179222.721973:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1875041472046720:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788179222.722009:0:14276:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 418 last 0 00000020:00000080:2.0:1788179222.722046:0:14276:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xaa4c98508c499b12 00000004:00100000:2.0:1788179222.722060:0:14276:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788179222.722200:0:14276:0:(import.c:65:import_set_state_nolock()) ffff9bc9137e0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788179222.722253:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875041472046720:12345-0@lo:38:kworker.0 Request processed in 279us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179222.722261:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788179222.722301:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bc80361aa00 x1875041472046720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788179232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788179222.722315:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788179222.722333:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788179222.722338:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788179222.722353:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9bc910475000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788179222.722360:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc80361aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875041472046720:0@lo:38:kworker.0 00000100:00100000:3.0:1788179222.723131:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472046592 00000100:00100000:3.0:1788179222.723140:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472046592 00000100:00100000:3.0:1788179222.723190:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788179222.723199:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e79c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+12:3305:x1875041472046592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179222.723257:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e79c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+12:3305:x1875041472046592:12345-0@lo:400:kworker.0 Request processed in 60us (1507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179222.723265:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788179222.723826:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce136049-9565-40c1-979f-49dcc63d6657:3305:1875041472046592:0@lo:400:kworker.0 00010000:00010000:0.0:1788179223.232295:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179224.257459:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179225.280608:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788179225.785617:0:14706:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc02eaac30 20000000:00000080:1.0:1788179225.785641:0:14706:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bc92f37ac00 uarg=0000000000000000 20000000:01000000:0.0:1788179225.786499:0:14706:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788179225.786509:0:14706:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788179225.786514:0:14706:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788179225.787533:0:14707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1788179225.787898:0:14706:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788179225.799570:0:14706:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788179225.799606:0:14706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bc9136c5200/0xaa4c98508c499b19 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179225.799627:0:14706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc9137b4200/0xaa4c98508c499ada lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c499ad3 expref: 11 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179225.799635:0:14706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bc9136c5200/0xaa4c98508c499b19 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179225.799680:0:14706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc9137b4200/0xaa4c98508c499ada lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c499ad3 expref: 11 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179225.799696:0:14706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bc9137b4200/0xaa4c98508c499ada lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c499ad3 expref: 11 pid: 14266 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179225.799710:0:14706:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc907039f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14706:1875041472046848:0@lo:104: 00000100:00100000:2.0:1788179225.799778:0:14706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179225.799829:0:14706:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9354260c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788179225.800307:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472046848 00000100:00100000:3.0:1788179225.800326:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472046848 00000100:00100000:3.0:1788179225.800379:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788179225.800391:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90703bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce136049-9565-40c1-979f-49dcc63d6657+3:14706:x1875041472046848:12345-0@lo:104: 00010000:00010000:3.0:1788179225.800405:0:14257:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c499ad3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c499ada expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179225.800477:0:14257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788179225.800483:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90703bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce136049-9565-40c1-979f-49dcc63d6657+3:14706:x1875041472046848:12345-0@lo:104: Request processed in 95us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179225.800490:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788179225.800511:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788179225.800517:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c499ad3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c499ada expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179225.800524:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc942173e00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:3.0:1788179225.800528:0:14261:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c499ad3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c499ada expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179225.800536:0:14261:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c499ad3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c499ada expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788179225.800544:0:14261:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c499ad3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c499ada expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788179225.800550:0:14261:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788179225.800583:0:14261:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c499ad3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c499ada expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179225.800590:0:14261:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788179225.800610:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c499ad3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c499ada expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179225.800623:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc942173e00/0xaa4c98508c499ad3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c499ada expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179225.800640:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179225.800641:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179225.800643:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179225.800661:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc80361a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce136049-9565-40c1-979f-49dcc63d6657:3306:1875041472046976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788179225.800692:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179225.800735:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472046976 00000100:00100000:3.0:1788179225.800739:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472046976 00010000:00010000:3.0:1788179225.800756:0:14258:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc9137b4200/0xaa4c98508c499ada lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c499ad3 expref: 12 pid: 14266 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179225.800777:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788179225.800783:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803619c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce136049-9565-40c1-979f-49dcc63d6657+12:3306:x1875041472046976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788179225.800793:0:14258:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179225.800798:0:14258:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc9137b4200/0xaa4c98508c499ada lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c499ad3 expref: 12 pid: 14266 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179225.800807:0:14258:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc9137b4200/0xaa4c98508c499ada lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c499ad3 expref: 12 pid: 14266 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179225.800823:0:14258:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bc9136c5200/0xaa4c98508c499b19 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179225.800832:0:14258:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9136c5200/0xaa4c98508c499b19 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179225.800844:0:14258:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bc9136c5200/0xaa4c98508c499b19 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179225.800885:0:14258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bc9136c5200/0xaa4c98508c499b19 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179225.800893:0:14258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bc9136c5200/0xaa4c98508c499b19 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179225.800899:0:14258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bc9136c5200/0xaa4c98508c499b19 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179225.800905:0:14258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5200 already unused, calling callback (ffffffffc1644220) 00010000:00010000:3.0:1788179225.800909:0:14258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bc9136c5200/0xaa4c98508c499b19 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179225.800916:0:14258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bc9136c5200/0xaa4c98508c499b19 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179225.800925:0:14258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bc9136c5200/0xaa4c98508c499b19 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179225.800935:0:14258:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179225.800979:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803619c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce136049-9565-40c1-979f-49dcc63d6657+12:3306:x1875041472046976:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179225.800985:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788179225.801021:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc80361a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce136049-9565-40c1-979f-49dcc63d6657:3306:1875041472046976:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788179225.805175:0:14706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc9137b4200/0xaa4c98508c499ada lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c499ad3 expref: 11 pid: 14266 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179225.805197:0:14706:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc907039f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14706:1875041472046848:0@lo:104: 00010000:00010000:2.0:1788179225.805223:0:14706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bc9136c5200/0xaa4c98508c499b19 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179225.805256:0:14706:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bc9136c5200/0xaa4c98508c499b19 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179225.805262:0:14706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bc9136c5200/0xaa4c98508c499b19 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179225.805269:0:14706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc9136c5200/0xaa4c98508c499b19 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179226.314453:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788179227.204319:0:14271:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788179227.204330:0:14271:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bc93f796000 from 10 10000000:01000000:0.0:1788179227.204336:0:14271:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788179227.204394:0:14271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c499b20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179227.204407:0:14271:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c499b20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179227.204435:0:14271:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c499b20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179227.204478:0:14271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a23b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472047104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788179227.204551:0:14271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179227.204608:0:14271:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9320990c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788179227.204921:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472047104 00000100:00100000:2.0:1788179227.204930:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472047104 00000100:00100000:2.0:1788179227.204981:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788179227.204992:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e79e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+11:14271:x1875041472047104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788179227.205006:0:14268:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179227.205021:0:14268:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9136c5c00/0xaa4c98508c499b27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c499b20 expref: -99 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179227.205057:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9136c5c00/0xaa4c98508c499b27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c499b20 expref: 12 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179227.205069:0:14268:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9136c5c00/0xaa4c98508c499b27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c499b20 expref: 12 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179227.205080:0:14268:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c5c00, rc 0) 00000100:00100000:2.0:1788179227.205128:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e79e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+12:14271:x1875041472047104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179227.205135:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788179227.205340:0:14271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a23b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472047104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788179227.205357:0:14271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c499b20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499b27 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179227.205366:0:14271:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c499b20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c499b27 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179227.205423:0:14271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a23b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472047232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788179227.205452:0:14271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179227.205488:0:14271:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9320990c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788179227.205584:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472047232 00000100:00100000:2.0:1788179227.205598:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472047232 00000100:00100000:2.0:1788179227.205633:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788179227.205641:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92677f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+12:14271:x1875041472047232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788179227.205926:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92677f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+12:14271:x1875041472047232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179227.205933:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788179227.206097:0:14271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a23b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472047232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788179227.206142:0:14271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a23b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472047360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788179227.206179:0:14271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179227.206203:0:14271:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9320990c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788179227.206221:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472047360 00000100:00100000:0.0:1788179227.206226:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472047360 00000100:00100000:0.0:1788179227.206258:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788179227.206264:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92677f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+12:14271:x1875041472047360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788179227.206420:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92677f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+12:14271:x1875041472047360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179227.206432:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788179227.206625:0:14271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a23b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472047360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788179227.217490:0:14765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788179227.218639:0:14271:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788179227.218668:0:14271:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788179227.218685:0:14271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c499b20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499b27 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179227.218714:0:14271:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c499b20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499b27 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179227.327992:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788179227.840432:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788179227.840443:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788179227.840446:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788179227.840450:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788179227.841593:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788179227.841619:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875041472047488:0@lo:400:kworker.0 00000100:00100000:2.0:1788179227.841696:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179227.842190:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472047488 00000100:00100000:0.0:1788179227.842199:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472047488 00000100:00100000:0.0:1788179227.842258:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788179227.842268:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875041472047488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179227.842334:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875041472047488:12345-0@lo:400:kworker.0 Request processed in 67us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179227.842341:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788179227.842399:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bc935a23b80 x1875041472047488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179227.842414:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875041472047488:0@lo:400:kworker.0 00000100:00100000:0.0:1788179227.843544:0:3304:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788179217/real 1788179217] req@ffff9bc803600000 x1875041472044032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788179227 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179227.843569:0:3304:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bc803600000 x1875041472044032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788179227 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179227.843580:0:3304:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788179217/real 1788179217] req@ffff9bc935a20e00 x1875041472043904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788179227 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179227.843610:0:3304:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bc935a20e00 x1875041472043904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788179227 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788179227.843626:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9bc910edd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788179227.843642:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788179227.843646:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875041472044032:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788179227.843651:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9bc910ed8000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788179227.843655:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788179227.843658:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875041472043904:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788179227.843729:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788179227.843733:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788179227.843736:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bc910ed8000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788179227.843740:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 413 00000100:00080000:0.0:1788179227.843745:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788179227.843750:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bc910ed8000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:0.0:1788179227.843778:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bc935a20e00 x1875041472047616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788179227.843802:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788179227.843806:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788179227.843807:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bc910edd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788179227.843811:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 413 00000100:00080000:0.0:1788179227.843814:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788179227.843818:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bc910edd000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:0.0:1788179227.843829:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bc935a23b80 x1875041472047744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788179227.843970:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875041472047616:0@lo:8:kworker.0 00000400:00000100:2.0:1788179227.844018:0:3304:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875041472047616 offset 0 length 520: 4 00000100:00100000:2.0:1788179227.844063:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875041472047744:0@lo:8:kworker.0 00000400:00000100:2.0:1788179227.844082:0:3304:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875041472047744 offset 0 length 520: 4 00010000:00010000:3.0:1788179228.352965:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179229.375949:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788179229.889957:0:14308:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1788179230.390202:0:14906:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788179230.390207:0:14906:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788179230.390320:0:14906:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9bc903975800 00000020:01000004:2.0:1788179230.392007:0:14906:0:(tgt_mount.c:2577:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788179230.392029:0:14906:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788179230.392049:0:14906:0:(genops.c:414:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9bc93b6799c0) 00000020:00000080:2.0:1788179230.392070:0:14906:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00010000:00010000:3.0:1788179230.401481:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788179230.425636:0:14906:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788179230.429509:0:14906:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788179230.431764:0:14906:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788179230.432144:0:14906:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788179230.433161:0:14906:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788179230.433621:0:14906:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 229: rc = 0 00100000:10000000:1.0:1788179230.433725:0:14906:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 229: rc = 0 00100000:10000000:1.0:1788179230.433916:0:14906:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 229: rc = 0 00100000:10000000:1.0:1788179230.434492:0:14906:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 659: rc = 0 00100000:10000000:1.0:1788179230.434985:0:14906:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 659: rc = 0 00100000:10000000:1.0:1788179230.435243:0:14906:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 659: rc = 0 00100000:10000000:1.0:1788179230.435590:0:14906:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 659: rc = 0 00100000:10000000:1.0:1788179230.435937:0:14906:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 659: rc = 0 00100000:10000000:1.0:1788179230.436206:0:14906:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 659: rc = 0 00000020:00000080:1.0:1788179230.438790:0:14906:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788179230.438804:0:14906:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788179230.438816:0:14906:0:(genops.c:1407:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xaa4c98508c499b35 00000020:01000004:1.0:1788179230.438825:0:14906:0:(tgt_mount.c:2662:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788179230.438965:0:14906:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.102@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788179230.438968:0:14906:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788179230.438974:0:14906:0:(tgt_mount.c:1875:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788179230.438978:0:14906:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788179230.438991:0:14906:0:(genops.c:414:class_newdev()) Allocate new device OSS (ffff9bc93fb3cd40) 00000020:00000080:1.0:1788179230.439014:0:14906:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1788179230.440258:0:14906:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788179230.440479:0:14906:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788179230.440485:0:14906:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788179230.442434:0:14906:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788179230.442445:0:14906:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788179230.444234:0:14906:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788179230.444247:0:14906:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788179230.447217:0:14906:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788179230.447399:0:14906:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788179230.447406:0:14906:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788179230.450468:0:14906:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788179230.450481:0:14906:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788179230.468581:0:14906:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788179230.468816:0:14906:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788179230.468822:0:14906:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788179230.470235:0:14906:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788179230.470248:0:14906:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788179230.471208:0:14906:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788179230.471218:0:14906:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788179230.473649:0:14906:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788179230.473816:0:14906:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788179230.473822:0:14906:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788179230.474470:0:14906:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788179230.474477:0:14906:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788179230.505845:0:14906:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788179230.506244:0:14906:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788179230.506250:0:14906:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788179230.509954:0:14906:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788179230.509972:0:14906:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788179230.511669:0:14906:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788179230.511699:0:14906:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788179230.511706:0:14906:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.102@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788179230.523562:0:14906:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.102@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788179230.523607:0:14906:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.102@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788179230.523612:0:14906:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788179230.523614:0:14906:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788179230.523616:0:14906:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788179230.523617:0:14906:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788179230.523618:0:14906:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788179230.523619:0:14906:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788179230.523621:0:14906:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788179230.523623:0:14906:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788179230.523624:0:14906:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788179230.523627:0:14906:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788179230.523630:0:14906:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788179230.523631:0:14906:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788179230.523632:0:14906:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788179230.523633:0:14906:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788179230.523634:0:14906:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788179230.523635:0:14906:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788179230.523636:0:14906:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788179230.523638:0:14906:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788179230.523638:0:14906:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788179230.523662:0:14906:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788179230.523680:0:14906:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472047872:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788179230.523738:0:14906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179230.523780:0:14906:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc935394900 going to sleep for 11 seconds 00000100:00100000:0.0:1788179230.524173:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472047872 00000100:00100000:0.0:1788179230.524181:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472047872 00000100:00100000:0.0:1788179230.524239:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788179230.524249:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92677ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+12:14906:x1875041472047872:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788179230.524281:0:14268:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788179230.524285:0:14268:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788179230.524289:0:14268:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788179230.532827:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92677ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+12:14906:x1875041472047872:12345-0@lo:253:mount.lustre.0 Request processed in 8567us (9075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179230.532845:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788179230.533282:0:14906:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472047872:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788179230.533300:0:14906:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788179230.533303:0:14906:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788179230.533305:0:14906:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788179230.533306:0:14906:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788179230.533308:0:14906:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788179230.533309:0:14906:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788179230.533310:0:14906:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788179230.533312:0:14906:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788179230.533313:0:14906:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788179230.533315:0:14906:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788179230.533400:0:14906:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bc903975800 from lustre-OST0000 10000000:01000000:1.0:1788179230.533428:0:14906:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788179230.533522:0:14906:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788179230.533529:0:14906:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bc9265c19c0 local copy 00010000:00010000:1.0:1788179230.533540:0:14906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317e400/0xaa4c98508c499a2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499a32 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179230.533758:0:14906:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472048000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788179230.533797:0:14906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179230.533892:0:14906:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc935394000 going to sleep for 11 seconds 00000100:00100000:3.0:1788179230.534074:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472048000 00000100:00100000:3.0:1788179230.534081:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472048000 00000100:00100000:3.0:1788179230.534168:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788179230.534176:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92677e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+12:14906:x1875041472048000:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788179230.534422:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92677e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+12:14906:x1875041472048000:12345-0@lo:501:mount.lustre.0 Request processed in 246us (623us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788179230.534430:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788179230.534642:0:14906:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472048000:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788179230.534657:0:14906:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788179230.534783:0:14906:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788179230.534790:0:14906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317e400/0xaa4c98508c499a2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499a32 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179230.534800:0:14906:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc91317e400/0xaa4c98508c499a2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499a32 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788179230.534825:0:14906:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bc903975800 10000000:01000000:1.0:1788179230.534829:0:14906:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788179230.534833:0:14906:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9bc9265c19c0 10000000:01000000:1.0:1788179230.534835:0:14906:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788179230.534839:0:14906:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9bc9265c19c0 from 1 10000000:01000000:1.0:1788179230.534842:0:14906:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788179230.534884:0:14906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc942172200/0xaa4c98508c499b43 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179230.534892:0:14906:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc942172200/0xaa4c98508c499b43 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179230.535177:0:14906:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc942172200/0xaa4c98508c499b43 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179230.535196:0:14906:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472048128:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788179230.535236:0:14906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179230.535318:0:14906:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc935394000 going to sleep for 11 seconds 00000100:00100000:0.0:1788179230.535423:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472048128 00000100:00100000:0.0:1788179230.535429:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472048128 00000100:00100000:0.0:1788179230.535584:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788179230.535594:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92677e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+12:14906:x1875041472048128:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788179230.535608:0:14268:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179230.535626:0:14268:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc91317e000/0xaa4c98508c499b4a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c499b43 expref: -99 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179230.535663:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc91317e000/0xaa4c98508c499b4a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c499b43 expref: 13 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179230.535686:0:14268:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc91317e000/0xaa4c98508c499b4a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c499b43 expref: 13 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179230.535695:0:14268:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317e000, rc 0) 00000100:00100000:0.0:1788179230.535744:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92677e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+13:14906:x1875041472048128:12345-0@lo:101:mount.lustre.0 Request processed in 151us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179230.535751:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788179230.535819:0:14906:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472048128:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788179230.535831:0:14906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc942172200/0xaa4c98508c499b43 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499b4a expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179230.535839:0:14906:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc942172200/0xaa4c98508c499b43 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c499b4a expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788179230.535890:0:14906:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788179230.535973:0:14906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc942172200/0xaa4c98508c499b43 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499b4a expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179230.536050:0:14906:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc942172200/0xaa4c98508c499b43 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499b4a expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788179230.536058:0:14906:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788179230.536082:0:14906:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788179230.536087:0:14906:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788179230.536090:0:14906:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788179230.536110:0:14906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc942172400/0xaa4c98508c499b51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179230.536116:0:14906:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc942172400/0xaa4c98508c499b51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179230.536131:0:14906:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc942172400/0xaa4c98508c499b51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179230.536146:0:14906:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472048256:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788179230.536173:0:14906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179230.536347:0:14906:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc935394000 going to sleep for 11 seconds 00000100:00100000:2.0:1788179230.536424:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472048256 00000100:00100000:2.0:1788179230.536430:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472048256 00000100:00100000:2.0:1788179230.536463:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788179230.536469:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92677d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+13:14906:x1875041472048256:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788179230.536477:0:14269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179230.536486:0:14269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9136c4000/0xaa4c98508c499b58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c499b51 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179230.536508:0:14269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9136c4000/0xaa4c98508c499b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c499b51 expref: 14 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179230.536517:0:14269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9136c4000/0xaa4c98508c499b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c499b51 expref: 14 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179230.536523:0:14269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9136c4000, rc 0) 00000100:00100000:2.0:1788179230.536563:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92677d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+14:14906:x1875041472048256:12345-0@lo:101:mount.lustre.0 Request processed in 94us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179230.536569:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788179230.536691:0:14906:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472048256:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788179230.536703:0:14906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc942172400/0xaa4c98508c499b51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499b58 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179230.536710:0:14906:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc942172400/0xaa4c98508c499b51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c499b58 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788179230.537730:0:14906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788179230.539759:0:14906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788179230.540632:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788179230.540690:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788179230.540723:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788179230.540771:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788179230.540811:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788179230.540846:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788179230.541187:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788179230.541196:0:14906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788179230.541292:0:14906:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472048384:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788179230.541429:0:14906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179230.541533:0:14906:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc935394840 going to sleep for 11 seconds 00000100:00100000:2.0:1788179230.541605:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472048384 00000100:00100000:2.0:1788179230.541613:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472048384 00000100:00100000:2.0:1788179230.541712:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788179230.541722:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92677cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+14:14906:x1875041472048384:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788179230.542149:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92677cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+14:14906:x1875041472048384:12345-0@lo:501:mount.lustre.0 Request processed in 427us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179230.542157:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788179230.542249:0:14906:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472048384:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788179230.542297:0:14906:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472048512:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788179230.542611:0:14906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179230.542786:0:14906:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc935394840 going to sleep for 11 seconds 00000100:00100000:3.0:1788179230.542820:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472048512 00000100:00100000:3.0:1788179230.542827:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472048512 00000100:00100000:3.0:1788179230.543117:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788179230.543128:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92677e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+14:14906:x1875041472048512:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788179230.545206:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92677e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+14:14906:x1875041472048512:12345-0@lo:503:mount.lustre.0 Request processed in 2071us (2586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179230.545221:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788179230.545353:0:14906:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472048512:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788179230.547662:0:14906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788179230.547763:0:14906:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472048640:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788179230.547838:0:14906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179230.548113:0:14906:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc935394840 going to sleep for 11 seconds 00000100:00100000:0.0:1788179230.548205:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472048640 00000100:00100000:0.0:1788179230.548213:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472048640 00000100:00100000:0.0:1788179230.548275:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788179230.548285:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92677dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+14:14906:x1875041472048640:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788179230.548739:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92677dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+14:14906:x1875041472048640:12345-0@lo:502:mount.lustre.0 Request processed in 454us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179230.548748:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788179230.548894:0:14906:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472048640:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788179230.549732:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788179230.550439:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788179230.550482:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788179230.550605:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788179230.550650:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788179230.550681:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788179230.550730:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788179230.550765:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788179230.550797:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788179230.550845:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788179230.551085:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788179230.551131:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788179230.551178:0:14906:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472048768:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788179230.551255:0:14906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179230.551365:0:14906:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc935394840 going to sleep for 11 seconds 00000100:00100000:3.0:1788179230.551479:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472048768 00000100:00100000:3.0:1788179230.551486:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472048768 00000100:00100000:3.0:1788179230.551652:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788179230.551662:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92677c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+14:14906:x1875041472048768:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788179230.552320:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92677c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+14:14906:x1875041472048768:12345-0@lo:502:mount.lustre.0 Request processed in 658us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179230.552339:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788179230.552674:0:14906:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472048768:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788179230.552785:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788179230.552809:0:14906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788179230.557623:0:14920:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788179230.557637:0:14920:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788179230.557645:0:14920:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788179230.557647:0:14920:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788179230.557652:0:14920:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788179230.557671:0:14920:0:(genops.c:414:class_newdev()) Allocate new device lustre-OST0000 (ffff9bc9265c3380) 00000020:00000080:3.0:1788179230.557697:0:14920:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788179230.557703:0:14920:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788179230.557782:0:14920:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bc903975800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788179230.557792:0:14920:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788179230.557799:0:14920:0:(genops.c:1407:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xaa4c98508c499b66 00010000:00010000:3.0:1788179230.566151:0:14920:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788179230.567715:0:14920:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1788179230.576541:0:14920:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788179230.586449:0:14920:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788179230.586464:0:14920:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788179230.586471:0:14920:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788179230.586473:0:14920:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788179230.586478:0:14920:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788179230.586481:0:14920:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1788179230.586482:0:14920:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788179230.586484:0:14920:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788179230.586485:0:14920:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788179230.586488:0:14920:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788179230.586489:0:14920:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788179230.586492:0:14920:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788179230.586509:0:14920:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788179230.586511:0:14920:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788179230.586515:0:14920:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788179230.586517:0:14920:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788179230.586520:0:14920:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788179230.586523:0:14920:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788179230.586524:0:14920:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788179230.586526:0:14920:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788179230.586528:0:14920:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788179230.586530:0:14920:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788179230.586817:0:14920:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788179230.586932:0:14920:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788179230.586937:0:14920:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788179230.586939:0:14920:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788179230.586942:0:14920:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788179230.587310:0:14906:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788179230.587352:0:14906:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788179230.587378:0:14906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc942172400/0xaa4c98508c499b51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499b58 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179230.587391:0:14906:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc942172400/0xaa4c98508c499b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499b58 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788179230.587399:0:14906:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bc903975800 from 1 10000000:01000000:3.0:1788179230.587403:0:14906:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788179230.587443:0:14906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499b6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179230.587464:0:14906:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499b6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179230.587475:0:14906:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499b6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179230.587503:0:14906:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc80361a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472048896:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788179230.587582:0:14906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179230.587626:0:14906:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9357d79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788179230.587878:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472048896 00000100:00100000:0.0:1788179230.587886:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472048896 00000100:00100000:0.0:1788179230.588162:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788179230.588172:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92677f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+14:14906:x1875041472048896:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788179230.588189:0:14268:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179230.588203:0:14268:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc91317ee00/0xaa4c98508c499b74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c499b6d expref: -99 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179230.588230:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc91317ee00/0xaa4c98508c499b74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c499b6d expref: 15 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179230.588239:0:14268:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc91317ee00/0xaa4c98508c499b74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c499b6d expref: 15 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179230.588260:0:14268:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317ee00, rc 0) 00000100:00100000:0.0:1788179230.588316:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92677f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+15:14906:x1875041472048896:12345-0@lo:101:mount.lustre.0 Request processed in 144us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179230.588378:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788179230.588976:0:14906:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc80361a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472048896:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788179230.589133:0:14906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499b6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499b74 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179230.589144:0:14906:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499b6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c499b74 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788179230.593259:0:14906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788179230.596583:0:14906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788179230.596920:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788179230.596969:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788179230.597051:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788179230.597060:0:14906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788179230.597153:0:14906:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc80361a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472049024:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788179230.597222:0:14906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179230.597278:0:14906:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9357d79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788179230.599170:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472049024 00000100:00100000:0.0:1788179230.599185:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472049024 00000100:00100000:0.0:1788179230.600095:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788179230.600110:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92677c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+15:14906:x1875041472049024:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788179230.600417:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92677c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+15:14906:x1875041472049024:12345-0@lo:501:mount.lustre.0 Request processed in 311us (3193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179230.600425:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788179230.600550:0:14906:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc80361a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472049024:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788179230.600602:0:14906:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc80361a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472049152:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788179230.600653:0:14906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179230.603838:0:14906:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9357d79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788179230.609132:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472049152 00000100:00100000:1.0:1788179230.609149:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472049152 00000100:00100000:1.0:1788179230.609213:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788179230.609224:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92677d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+15:14906:x1875041472049152:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788179230.609646:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92677d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+15:14906:x1875041472049152:12345-0@lo:503:mount.lustre.0 Request processed in 423us (8991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179230.609654:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788179230.615494:0:14906:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc80361a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472049152:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788179230.618537:0:14906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788179230.618635:0:14906:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc80361a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472049280:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788179230.618723:0:14906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179230.618819:0:14906:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9357d79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788179230.621217:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472049280 00000100:00100000:2.0:1788179230.621231:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472049280 00000100:00100000:1.0:1788179230.621544:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788179230.621556:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fad5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+15:14906:x1875041472049280:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788179230.622104:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fad5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+15:14906:x1875041472049280:12345-0@lo:502:mount.lustre.0 Request processed in 549us (3379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179230.622112:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788179230.622400:0:14906:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc80361a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472049280:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788179230.622693:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788179230.622755:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788179230.622809:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788179230.623412:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788179230.623454:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788179230.623514:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788179230.623555:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788179230.623592:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788179230.623637:0:14906:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a23800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472049408:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788179230.623706:0:14906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179230.623800:0:14906:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93fb0c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788179230.624322:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472049408 00000100:00100000:1.0:1788179230.624402:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472049408 00000100:00100000:1.0:1788179230.624485:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788179230.624495:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fad6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+15:14906:x1875041472049408:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788179230.624703:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fad6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+15:14906:x1875041472049408:12345-0@lo:502:mount.lustre.0 Request processed in 209us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179230.624711:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788179230.624793:0:14906:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a23800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472049408:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788179230.624935:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788179230.624954:0:14906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788179230.626176:0:14924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788179230.626188:0:14924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788179230.626190:0:14924:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788179230.626196:0:14924:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bc903975800 00000020:00000080:2.0:1788179230.626199:0:14924:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788179230.626208:0:14924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788179230.626210:0:14924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788179230.626211:0:14924:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788179230.626214:0:14924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788179230.626216:0:14924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788179230.626218:0:14924:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788179230.626221:0:14924:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bc903975800 00000020:00000080:2.0:1788179230.626223:0:14924:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788179230.626282:0:14924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788179230.626286:0:14924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788179230.626287:0:14924:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788179230.626289:0:14924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788179230.626301:0:14924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788179230.626303:0:14924:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788179230.626306:0:14924:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bc903975800 00000020:00000080:2.0:1788179230.626308:0:14924:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788179230.626358:0:14924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788179230.626362:0:14924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788179230.626363:0:14924:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788179230.626366:0:14924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788179230.626778:0:14906:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788179230.634968:0:14906:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788179230.635010:0:14906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499b6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499b74 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179230.635023:0:14906:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499b6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499b74 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788179230.635074:0:14906:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788179230.635077:0:14906:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bc903975800 10000000:01000000:0.0:1788179230.635081:0:14906:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bc903975800 10000000:01000000:0.0:1788179230.635085:0:14906:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788179230.635090:0:14906:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9bc903975800 from 1 10000000:01000000:0.0:1788179230.635093:0:14906:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788179230.635132:0:14906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317fc00/0xaa4c98508c499b7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179230.635141:0:14906:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc91317fc00/0xaa4c98508c499b7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179230.635152:0:14906:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc91317fc00/0xaa4c98508c499b7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179230.635175:0:14906:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a23800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472049536:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788179230.635241:0:14906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179230.640022:0:14906:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93fb0c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788179230.641858:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472049536 00000100:00100000:3.0:1788179230.641873:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472049536 00000100:00100000:3.0:1788179230.642039:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788179230.642051:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+15:14906:x1875041472049536:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788179230.642070:0:14269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179230.642090:0:14269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9137b4000/0xaa4c98508c499b82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c499b7b expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179230.642119:0:14269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9137b4000/0xaa4c98508c499b82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c499b7b expref: 16 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179230.642131:0:14269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9137b4000/0xaa4c98508c499b82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c499b7b expref: 16 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179230.642140:0:14269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4000, rc 0) 00000100:00100000:3.0:1788179230.642229:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+16:14906:x1875041472049536:12345-0@lo:101:mount.lustre.0 Request processed in 181us (6987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179230.642237:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788179230.643036:0:14906:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a23800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472049536:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788179230.643059:0:14906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc91317fc00/0xaa4c98508c499b7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499b82 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179230.643070:0:14906:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc91317fc00/0xaa4c98508c499b7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c499b82 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788179230.645956:0:14906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788179230.646555:0:14906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788179230.650012:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788179230.650113:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788179230.650145:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788179230.650190:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788179230.650224:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788179230.650268:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788179230.650300:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788179230.650330:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788179230.650373:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788179230.650406:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788179230.650438:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788179230.650481:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788179230.650513:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788179230.650568:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788179230.650619:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788179230.650656:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788179230.650693:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788179230.657162:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788179230.657264:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788179230.657304:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788179230.657361:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788179230.657398:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788179230.657433:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788179230.657498:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788179230.657540:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788179230.657577:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788179230.657626:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788179230.657668:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788179230.657759:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788179230.657776:0:14906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788179230.657901:0:14906:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472049664:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788179230.657964:0:14906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179230.658895:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472049664 00000100:00100000:2.0:1788179230.658907:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472049664 00000100:00100000:2.0:1788179230.658964:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788179230.658974:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+16:14906:x1875041472049664:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788179230.659268:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+16:14906:x1875041472049664:12345-0@lo:501:mount.lustre.0 Request processed in 294us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179230.659276:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788179230.659564:0:14906:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9353940c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788179230.659589:0:14906:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472049664:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788179230.659632:0:14906:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472049792:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788179230.659676:0:14906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179230.659703:0:14906:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9353940c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788179230.662005:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472049792 00000100:00100000:2.0:1788179230.662024:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472049792 00000100:00100000:2.0:1788179230.662087:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788179230.662097:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fad5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+16:14906:x1875041472049792:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788179230.662317:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fad5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+16:14906:x1875041472049792:12345-0@lo:503:mount.lustre.0 Request processed in 221us (2640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179230.662324:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788179230.662496:0:14906:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472049792:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788179230.663335:0:14906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788179230.663410:0:14906:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472049920:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788179230.663463:0:14906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179230.663502:0:14906:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9353940c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788179230.663974:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472049920 00000100:00100000:2.0:1788179230.663981:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472049920 00000100:00100000:2.0:1788179230.664037:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788179230.664046:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fad6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+16:14906:x1875041472049920:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788179230.664255:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fad6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+16:14906:x1875041472049920:12345-0@lo:502:mount.lustre.0 Request processed in 209us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179230.664272:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788179230.666960:0:14906:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472049920:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788179230.667321:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788179230.667387:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788179230.667421:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788179230.667467:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788179230.667505:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788179230.667554:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788179230.667592:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788179230.667628:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788179230.667679:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788179230.667716:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788179230.669891:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788179230.670041:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788179230.670082:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788179230.670138:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788179230.670191:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788179230.670229:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788179230.670264:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788179230.670313:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788179230.670349:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788179230.670381:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788179230.670433:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788179230.670470:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788179230.670506:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788179230.670554:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788179230.670590:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788179230.670624:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788179230.670673:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788179230.670708:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788179230.670738:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788179230.672216:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788179230.672251:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788179230.672277:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788179230.672304:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788179230.672341:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788179230.672369:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788179230.672417:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788179230.672449:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788179230.672475:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788179230.672513:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788179230.672540:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788179230.672586:0:14906:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472050048:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788179230.672655:0:14906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179230.674067:0:14906:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9353940c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788179230.678615:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472050048 00000100:00100000:2.0:1788179230.678633:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472050048 00000100:00100000:2.0:1788179230.678729:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788179230.678816:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fad6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+16:14906:x1875041472050048:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788179230.679145:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fad6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+16:14906:x1875041472050048:12345-0@lo:502:mount.lustre.0 Request processed in 407us (6489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179230.679153:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788179230.679306:0:14906:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472050048:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788179230.679432:0:14906:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788179230.679450:0:14906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788179230.686224:0:14929:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788179230.686244:0:14929:0:(genops.c:414:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9bc93fb399c0) 00000020:00000080:1.0:1788179230.686268:0:14929:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788179230.686482:0:14929:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bc903975800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788179230.686486:0:14929:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bc903975800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788179230.686489:0:14929:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bc903975800 3 00010000:00080000:1.0:1788179230.686521:0:14929:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bc9070e6000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.102@tcp at head 00010000:00010000:1.0:1788179230.689075:0:14929:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788179230.689190:0:14929:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788179230.689227:0:14929:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788179230.689243:0:14929:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xaa4c98508c499b90 00000100:00080000:1.0:1788179230.689253:0:14929:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788179230.689259:0:14929:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9bc9070e6000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:1.0:1788179230.689292:0:14929:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bc803602a00 x1875041472050176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788179230.689368:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875041472050176:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788179230.689435:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788179230.689508:0:14929:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788179230.689535:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788179230.689539:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788179230.689542:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788179230.689544:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788179230.689595:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788179230.689604:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041472050304:0@lo:400:kworker.0 00000100:00100000:1.0:1788179230.689633:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179230.689713:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472050176 00000100:00100000:3.0:1788179230.689720:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472050176 00000100:00100000:3.0:1788179230.689762:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472050304 00000100:00100000:3.0:1788179230.689772:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472050304 00000100:00100000:3.0:1788179230.689800:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788179230.689807:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041472050304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179230.689896:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041472050304:12345-0@lo:400:kworker.0 Request processed in 86us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179230.689905:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788179230.689921:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788179230.689925:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90703b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1875041472050176:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788179230.689959:0:14274:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:3.0:1788179230.689989:0:14274:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xaa4c98508c499b97 00000004:00100000:3.0:1788179230.690015:0:14274:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788179230.690049:0:14274:0:(import.c:65:import_set_state_nolock()) ffff9bc90f7a4000 : changing import state from RECOVER to FULL 00000040:00080000:1.0:1788179230.694444:0:14929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:3.0:1788179230.703181:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90703b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875041472050176:12345-0@lo:38:llog_process_th.0 Request processed in 13243us (13734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179230.703197:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:0.0:1788179230.704986:0:14906:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788179230.705042:0:14906:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788179230.705066:0:14906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317fc00/0xaa4c98508c499b7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499b82 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179230.705092:0:14906:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc91317fc00/0xaa4c98508c499b7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499b82 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788179230.705150:0:14906:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788179230.705152:0:14906:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788179230.705153:0:14906:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788179230.705154:0:14906:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788179230.705156:0:14906:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788179230.705157:0:14906:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788179230.705158:0:14906:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788179230.705160:0:14906:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788179230.705161:0:14906:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788179230.705165:0:14906:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788179230.705168:0:14906:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788179230.705169:0:14906:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788179230.705170:0:14906:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788179230.705172:0:14906:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788179230.705173:0:14906:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788179230.705174:0:14906:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788179230.705175:0:14906:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788179230.705176:0:14906:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788179230.705177:0:14906:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788179230.705204:0:14906:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788179230.705226:0:14906:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a21880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472050432:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788179230.705321:0:14906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179230.705369:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472050432 00000100:00100000:0.0:1788179230.705377:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472050432 00000100:00100000:0.0:1788179230.705423:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788179230.705431:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fad7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+16:14906:x1875041472050432:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788179230.705456:0:14268:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788179230.705471:0:14268:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1788179230.706915:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bc803602a00 x1875041472050176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788179240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179230.706930:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788179230.706939:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788179230.706948:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788179230.706954:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788179230.706958:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9bc9070e6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788179230.706966:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1875041472050176:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788179230.707108:0:14906:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93fb0c6c0 going to sleep for 11 seconds 00010000:00080000:2.0:1788179230.707937:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9bc803601c00 x1875041472050304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788179230.707951:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041472050304:0@lo:400:kworker.0 20000000:01000000:2.0:1788179230.753544:0:14268:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788179230.753567:0:14268:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788179230.753670:0:14290:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788179230.753676:0:14290:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788179230.753713:0:14290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499b9e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179230.753736:0:14290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc9136c5e00/0xaa4c98508c499b0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c499b04 expref: 16 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179230.753755:0:14290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499b9e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179230.753801:0:14290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc9136c5e00/0xaa4c98508c499b0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c499b04 expref: 16 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179230.753816:0:14290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bc9136c5e00/0xaa4c98508c499b0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c499b04 expref: 16 pid: 14268 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179230.753832:0:14290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803600a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14290:1875041472050560:0@lo:104: 00000100:00100000:1.0:1788179230.753932:0:14290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179230.753976:0:14290:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc935394480 going to sleep for 11 seconds 00000100:00100000:0.0:1788179230.754131:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472050560 00000100:00100000:0.0:1788179230.754139:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472050560 00000100:00100000:0.0:1788179230.754200:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788179230.754208:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803600e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce136049-9565-40c1-979f-49dcc63d6657+3:14290:x1875041472050560:12345-0@lo:104: 00010000:00010000:0.0:1788179230.754222:0:14257:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc91317f200/0xaa4c98508c499b04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c499b0b expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179230.754275:0:14257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788179230.754281:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803600e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce136049-9565-40c1-979f-49dcc63d6657+3:14290:x1875041472050560:12345-0@lo:104: Request processed in 74us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179230.754288:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788179230.754340:0:14290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803600a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14290:1875041472050560:0@lo:104: 00010000:00010000:0.0:1788179230.754358:0:14290:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499b9e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179230.757047:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788179230.757060:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc91317f200/0xaa4c98508c499b04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c499b0b expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179230.757071:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f200 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:3.0:1788179230.757076:0:14261:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc91317f200/0xaa4c98508c499b04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c499b0b expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179230.757086:0:14261:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc91317f200/0xaa4c98508c499b04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c499b0b expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788179230.757094:0:14261:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc91317f200/0xaa4c98508c499b04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c499b0b expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788179230.757118:0:14261:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788179230.757165:0:14261:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc91317f200/0xaa4c98508c499b04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c499b0b expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179230.757171:0:14261:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788179230.757201:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc91317f200/0xaa4c98508c499b04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c499b0b expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179230.757208:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc91317f200/0xaa4c98508c499b04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c499b0b expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179230.757227:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179230.757229:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179230.757231:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179230.757247:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788179230.757264:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc80361b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce136049-9565-40c1-979f-49dcc63d6657:3306:1875041472050688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788179230.757325:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179230.757380:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472050688 00000100:00100000:3.0:1788179230.757387:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472050688 00010000:00010000:3.0:1788179230.757415:0:14260:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc9136c5e00/0xaa4c98508c499b0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c499b04 expref: 17 pid: 14268 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179230.757442:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788179230.757450:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc80361a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce136049-9565-40c1-979f-49dcc63d6657+17:3306:x1875041472050688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788179230.757462:0:14260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179230.757467:0:14260:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc9136c5e00/0xaa4c98508c499b0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c499b04 expref: 17 pid: 14268 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179230.757477:0:14260:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc9136c5e00/0xaa4c98508c499b0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c499b04 expref: 17 pid: 14268 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179230.757500:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc9136c5e00/0xaa4c98508c499b0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c499b04 expref: 17 pid: 14268 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179230.757514:0:14260:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499b9e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179230.757522:0:14260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499b9e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788179230.757536:0:14260:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003860985s 00010000:00010000:3.0:1788179230.757540:0:14260:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499b9e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179230.757547:0:14260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499b9e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179230.757554:0:14260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499b9e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179230.757561:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499b9e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179230.757566:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc942173c00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:3.0:1788179230.757570:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499b9e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179230.757578:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499b9e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179230.757593:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499b9e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179230.757611:0:14260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179230.757647:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc80361a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce136049-9565-40c1-979f-49dcc63d6657+16:3306:x1875041472050688:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179230.757654:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788179230.757695:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc80361b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce136049-9565-40c1-979f-49dcc63d6657:3306:1875041472050688:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788179230.757719:0:14290:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499b9e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179230.757727:0:14290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499b9e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179230.757733:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499b9e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179230.771213:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fad7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+15:14906:x1875041472050432:12345-0@lo:253:mount.lustre.0 Request processed in 65769us (65879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179230.771242:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788179230.771329:0:14906:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a21880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:14906:1875041472050432:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788179230.771344:0:14906:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788179230.771348:0:14906:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788179230.771349:0:14906:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788179230.771351:0:14906:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788179230.771352:0:14906:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788179230.771353:0:14906:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788179230.771354:0:14906:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788179230.771356:0:14906:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788179230.771358:0:14906:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788179230.771360:0:14906:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788179230.771393:0:14906:0:(tgt_mount.c:2766:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788179230.779124:0:14906:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788179230.779316:0:14906:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788179230.779481:0:14906:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788179230.779634:0:14906:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788179230.780293:0:14906:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788179230.780525:0:14906:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788179230.781512:0:14906:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788179230.836681:0:14906:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788179230.836689:0:14906:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788179230.836721:0:14906:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788179230.837263:0:14906:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.102@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788179230.837279:0:14906:0:(tgt_mount.c:2535:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788179230.837311:0:14906:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788179231.426558:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179232.448396:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788179232.769038:0:14271:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788179232.769048:0:14271:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9bc93f796000 from 7 10000000:01000000:0.0:1788179232.769054:0:14271:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788179232.769103:0:14271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c499ba5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179232.769120:0:14271:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c499ba5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179232.769134:0:14271:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c499ba5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179232.769163:0:14271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472050816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788179232.769238:0:14271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179232.769292:0:14271:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9266da840 going to sleep for 11 seconds 00000100:00100000:1.0:1788179232.769785:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472050816 00000100:00100000:1.0:1788179232.769795:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472050816 00000100:00100000:1.0:1788179232.769864:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788179232.769875:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fad4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+15:14271:x1875041472050816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788179232.770275:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179232.770294:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499bac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c499ba5 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179232.770335:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499bac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c499ba5 expref: 16 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179232.770347:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499bac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c499ba5 expref: 16 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179232.770355:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc942173c00, rc 0) 00000100:00100000:1.0:1788179232.771072:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fad4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+16:14271:x1875041472050816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1196us (1829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179232.771082:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788179232.771158:0:14271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472050816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788179232.771176:0:14271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c499ba5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499bac expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179232.771186:0:14271:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c499ba5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c499bac expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179232.771255:0:14271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803601180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472050944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788179232.771296:0:14271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179232.771340:0:14271:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9035890c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788179232.771581:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472050944 00000100:00100000:3.0:1788179232.771588:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472050944 00000100:00100000:3.0:1788179232.771628:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788179232.771636:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fad6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+16:14271:x1875041472050944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788179232.771652:0:14268:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788179232.771670:0:14268:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788179232.771673:0:14268:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788179232.771750:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fad6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+16:14271:x1875041472050944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179232.771757:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788179232.774231:0:14271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803601180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472050944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788179232.774311:0:14271:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788179232.774322:0:14271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c499ba5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499bac expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179232.774333:0:14271:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c499ba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499bac expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179233.475340:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179234.497059:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179235.520029:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788179236.034371:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788179236.034379:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788179236.034382:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788179236.034385:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788179236.034449:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc80361b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce136049-9565-40c1-979f-49dcc63d6657:3306:1875041472051072:0@lo:400:kworker.0 00000100:00100000:3.0:1788179236.034541:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179236.034618:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041472051200:0@lo:400:kworker.0 00000100:00100000:3.0:1788179236.034656:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179236.034680:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788179236.034687:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875041472051328:0@lo:400:kworker.0 00000100:00100000:3.0:1788179236.034711:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179236.034743:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472051072 00000100:00100000:3.0:1788179236.034750:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472051072 00000100:00100000:3.0:1788179236.034796:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788179236.034806:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fad5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+16:3306:x1875041472051072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179236.034890:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fad5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+16:3306:x1875041472051072:12345-0@lo:400:kworker.0 Request processed in 86us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179236.034899:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788179236.034937:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472051200 00000100:00100000:3.0:1788179236.034941:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472051200 00000100:00100000:3.0:1788179236.034978:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472051328 00000100:00100000:3.0:1788179236.034981:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472051328 00000100:00100000:3.0:1788179236.035018:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788179236.035025:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041472051200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179236.035081:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041472051200:12345-0@lo:400:kworker.0 Request processed in 57us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179236.035088:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788179236.035103:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788179236.035109:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875041472051328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179236.035135:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875041472051328:12345-0@lo:400:kworker.0 Request processed in 27us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179236.035141:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788179236.035364:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc803618e00 x1875041472051328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179236.035379:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875041472051328:0@lo:400:kworker.0 00010000:00080000:3.0:1788179236.035393:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc803618a80 x1875041472051200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179236.035402:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041472051200:0@lo:400:kworker.0 00000100:00100000:3.0:1788179236.035437:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc80361b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce136049-9565-40c1-979f-49dcc63d6657:3306:1875041472051072:0@lo:400:kworker.0 00000100:00080000:1.0:1788179236.037624:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788179236.545079:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179237.580997:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788179238.515750:0:15276:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788179238.607771:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788179239.104972:0:14308:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788179239.619828:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179240.642455:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788179241.162989:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788179241.163005:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788179241.163007:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788179241.163011:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788179241.163059:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875041472051584:0@lo:400:kworker.0 00000100:00100000:0.0:1788179241.163135:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179241.163194:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788179241.163200:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce136049-9565-40c1-979f-49dcc63d6657:3306:1875041472051456:0@lo:400:kworker.0 00000100:00100000:0.0:1788179241.163239:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179241.163274:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875041472051712:0@lo:400:kworker.0 00000100:00100000:0.0:1788179241.163303:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179241.163343:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472051584 00000100:00100000:0.0:1788179241.163351:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472051584 00000100:00100000:0.0:1788179241.163413:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472051712 00000100:00100000:0.0:1788179241.163417:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472051712 00000100:00100000:0.0:1788179241.163468:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788179241.163480:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875041472051584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179241.163550:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875041472051584:12345-0@lo:400:kworker.0 Request processed in 71us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179241.163558:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788179241.163587:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788179241.163595:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875041472051712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179241.163980:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875041472051712:12345-0@lo:400:kworker.0 Request processed in 386us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179241.163990:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788179241.164053:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc935a22a00 x1875041472051712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179241.164070:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875041472051712:0@lo:400:kworker.0 00010000:00080000:0.0:1788179241.164109:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc935a20000 x1875041472051584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179241.164119:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875041472051584:0@lo:400:kworker.0 00000100:00100000:2.0:1788179241.164262:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472051456 00000100:00100000:2.0:1788179241.164267:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472051456 00000100:00100000:2.0:1788179241.164309:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788179241.164316:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fad4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+16:3306:x1875041472051456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179241.164358:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fad4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+16:3306:x1875041472051456:12345-0@lo:400:kworker.0 Request processed in 43us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179241.164365:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788179241.164727:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce136049-9565-40c1-979f-49dcc63d6657:3306:1875041472051456:0@lo:400:kworker.0 00000100:00080000:0.0:1788179241.165788:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788179241.664677:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179242.690690:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179243.009663:0:3304:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788179227/real 1788179227] req@ffff9bc935a20e00 x1875041472047616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788179242 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179243.009696:0:3304:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bc935a20e00 x1875041472047616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788179242 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179243.009706:0:3304:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788179227/real 1788179227] req@ffff9bc935a23b80 x1875041472047744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788179242 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179243.009731:0:3304:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9bc935a23b80 x1875041472047744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788179242 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788179243.009750:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9bc910ed8000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788179243.009779:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788179243.009783:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875041472047616:0@lo:8:kworker.0 00000100:00080000:3.0:1788179243.009789:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9bc910edd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788179243.009795:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788179243.009797:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875041472047744:0@lo:8:kworker.0 00000100:00080000:0.0:1788179243.010461:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788179243.010466:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788179243.010469:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bc910ed8000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788179243.010481:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 423 00000100:00080000:0.0:1788179243.010486:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788179243.010494:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9bc910ed8000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:0.0:1788179243.010513:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bc935a20000 x1875041472051968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788179243.010526:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788179243.010529:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788179243.010531:0:36:0:(import.c:65:import_set_state_nolock()) ffff9bc910edd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788179243.010534:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 423 00000100:00080000:0.0:1788179243.010537:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788179243.010541:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bc910edd000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:0.0:1788179243.010551:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bc935a22a00 x1875041472052096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788179243.010675:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce136049-9565-40c1-979f-49dcc63d6657:3308:1875041472051840:0@lo:400:kworker.0 00000100:00100000:0.0:1788179243.010740:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179243.010908:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472051840 00000100:00100000:3.0:1788179243.010917:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472051840 00000100:00100000:3.0:1788179243.010961:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788179243.010971:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fad7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+16:3308:x1875041472051840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179243.011021:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fad7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+16:3308:x1875041472051840:12345-0@lo:400:kworker.0 Request processed in 52us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179243.011028:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788179243.011061:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875041472051968:0@lo:8:kworker.0 00000100:00100000:3.0:1788179243.011091:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179243.011115:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875041472052096:0@lo:8:kworker.0 00000100:00100000:3.0:1788179243.011135:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179243.011180:0:14907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472051968 00000100:00100000:3.0:1788179243.011184:0:14907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472051968 00000100:00100000:3.0:1788179243.011208:0:14907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472052096 00000100:00100000:3.0:1788179243.011211:0:14907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472052096 00000100:00100000:3.0:1788179243.011221:0:14907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788179243.011232:0:14907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc80361b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1875041472051968:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788179243.011257:0:14907:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:3.0:1788179243.011286:0:14907:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa4c98508c499bb3 00002000:00100000:3.0:1788179243.011302:0:14907:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9bc90f7a6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211371b ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788179243.011306:0:14907:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788179243.011308:0:14907:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788179243.011621:0:14907:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788179243.011644:0:14907:0:(import.c:65:import_set_state_nolock()) ffff9bc90f7a7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788179243.011684:0:14907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc80361b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1875041472051968:12345-0@lo:8:kworker.0 Request processed in 451us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179243.011691:0:14907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788179243.011705:0:14907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788179243.011709:0:14907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1875041472052096:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788179243.011719:0:14907:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788179243.011744:0:14907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1875041472052096:12345-0@lo:8:kworker.0 Request processed in 34us (609us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788179243.011750:0:14907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788179243.011783:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc935a20000 x1875041472051968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788179263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179243.011805:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788179243.011812:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788179243.011819:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788179243.011823:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788179243.011825:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9bc910ed8000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788179243.011840:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788179243.011884:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875041472051968:0@lo:8:kworker.0 00000100:00080000:3.0:1788179243.011899:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9bc910edd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788179243.011903:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788179243.011906:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875041472052096:0@lo:8:kworker.0 00000004:00080000:3.0:1788179243.011949:0:14297:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1788179243.011965:0:14297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc80361b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14297:1875041472052608:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788179243.011991:0:14297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179243.012006:0:14297:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc8013bf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788179243.012016:0:14907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472052608 00000100:00100000:3.0:1788179243.012020:0:14907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472052608 00000100:00100000:3.0:1788179243.012048:0:14907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788179243.012054:0:14907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc80361a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14297:x1875041472052608:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788179243.014099:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce136049-9565-40c1-979f-49dcc63d6657:3308:1875041472051840:0@lo:400:kworker.0 00000100:00100000:0.0:1788179243.014127:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788179243.014136:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472052480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788179243.014194:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179243.014249:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875041472052352:0@lo:400:kworker.0 00000100:00100000:0.0:1788179243.014278:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179243.014297:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788179243.014303:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875041472052224:0@lo:400:kworker.0 00000100:00100000:0.0:1788179243.014325:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179243.014379:0:14911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472052480 00000100:00100000:0.0:1788179243.014386:0:14911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472052480 00000100:00100000:1.0:1788179243.014550:0:14912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788179243.014561:0:14912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875041472052480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788179243.014596:0:14912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788179243.014645:0:14912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875041472052480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179243.014651:0:14912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788179243.014721:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc803618e00 x1875041472052480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179259 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788179243.014739:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472052480:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1788179243.015223:0:14296:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788179243.015503:0:14296:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 439078653075ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788179243.017657:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472052352 00000100:00100000:0.0:1788179243.017670:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472052352 00000100:00100000:0.0:1788179243.017722:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472052224 00000100:00100000:0.0:1788179243.017725:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472052224 00000100:00100000:0.0:1788179243.017741:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788179243.017749:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875041472052352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179243.017841:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875041472052352:12345-0@lo:400:kworker.0 Request processed in 93us (3562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179243.017867:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788179243.017895:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788179243.017901:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875041472052224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179243.017925:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875041472052224:12345-0@lo:400:kworker.0 Request processed in 25us (3599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179243.017930:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788179243.017974:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc935a21180 x1875041472052224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179243.017989:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875041472052224:0@lo:400:kworker.0 00010000:00080000:0.0:1788179243.018000:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc935a23100 x1875041472052352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788179243.018008:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1875041472052352:0@lo:400:kworker.0 00000100:00080000:3.0:1788179243.025295:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788179243.025309:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1788179243.025898:0:14907:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788179243.025907:0:14907:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788179243.025912:0:14907:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:2.0:1788179243.053594:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788179243.053607:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005c29ec3/0xaa4c98508c499bba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.053625:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788179243.053629:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179243.053635:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005c29ec3/0xaa4c98508c499bba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.053652:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005c29ec3/0xaa4c98508c499bba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.053662:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005c29ec3/0xaa4c98508c499bba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.053669:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005c29ec3/0xaa4c98508c499bba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.053704:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788179243.054217:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788179243.054224:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052bc5d45/0xaa4c98508c499bc1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.054234:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788179243.054237:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179243.054242:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052bc5d45/0xaa4c98508c499bc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.054251:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052bc5d45/0xaa4c98508c499bc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.054260:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052bc5d45/0xaa4c98508c499bc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.054267:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052bc5d45/0xaa4c98508c499bc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.054286:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788179243.054298:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788179243.054304:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005c29ec3/0xaa4c98508c499bba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.054312:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5600 already unused, calling callback (ffffffffc1644220) 00010000:00010000:2.0:1788179243.054323:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005c29ec3/0xaa4c98508c499bba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.054332:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005c29ec3/0xaa4c98508c499bba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.054351:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005c29ec3/0xaa4c98508c499bba lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.054360:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005c29ec3/0xaa4c98508c499bba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.054380:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788179243.054383:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052bc5d45/0xaa4c98508c499bc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.054390:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c4600 already unused, calling callback (ffffffffc1644220) 00010000:00010000:2.0:1788179243.054393:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052bc5d45/0xaa4c98508c499bc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.054401:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052bc5d45/0xaa4c98508c499bc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.054410:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052bc5d45/0xaa4c98508c499bc1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.054417:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052bc5d45/0xaa4c98508c499bc1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.054434:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179243.054436:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179243.054437:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788179243.054824:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788179243.054831:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091d3ba7e/0xaa4c98508c499bc8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.054840:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788179243.054843:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179243.054869:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091d3ba7e/0xaa4c98508c499bc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.054892:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091d3ba7e/0xaa4c98508c499bc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.054901:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091d3ba7e/0xaa4c98508c499bc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.054908:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091d3ba7e/0xaa4c98508c499bc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.054922:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788179243.054930:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788179243.054934:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091d3ba7e/0xaa4c98508c499bc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.054951:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c4200 already unused, calling callback (ffffffffc1644220) 00010000:00010000:2.0:1788179243.054955:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091d3ba7e/0xaa4c98508c499bc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.054963:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091d3ba7e/0xaa4c98508c499bc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.054973:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091d3ba7e/0xaa4c98508c499bc8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.054980:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091d3ba7e/0xaa4c98508c499bc8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.054992:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179243.054994:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179243.054995:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788179243.055372:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788179243.055377:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da95f6ae/0xaa4c98508c499bcf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.055385:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788179243.055389:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179243.055393:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da95f6ae/0xaa4c98508c499bcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.055402:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da95f6ae/0xaa4c98508c499bcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.055415:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da95f6ae/0xaa4c98508c499bcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.055423:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da95f6ae/0xaa4c98508c499bcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.055435:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788179243.055442:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788179243.055446:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da95f6ae/0xaa4c98508c499bcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.055452:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5200 already unused, calling callback (ffffffffc1644220) 00010000:00010000:2.0:1788179243.055456:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da95f6ae/0xaa4c98508c499bcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.055463:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da95f6ae/0xaa4c98508c499bcf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.055473:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da95f6ae/0xaa4c98508c499bcf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.055481:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da95f6ae/0xaa4c98508c499bcf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.055493:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179243.055499:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179243.055501:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179243.057579:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788179243.062462:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788179243.062482:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f81f1ff/0xaa4c98508c499bd6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.062501:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788179243.062506:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179243.062514:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f81f1ff/0xaa4c98508c499bd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.062541:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f81f1ff/0xaa4c98508c499bd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.062552:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f81f1ff/0xaa4c98508c499bd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.062568:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f81f1ff/0xaa4c98508c499bd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.062593:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788179243.062620:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788179243.062630:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f81f1ff/0xaa4c98508c499bd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.062656:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5400 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179243.062662:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f81f1ff/0xaa4c98508c499bd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.062673:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f81f1ff/0xaa4c98508c499bd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.062695:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f81f1ff/0xaa4c98508c499bd6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.062703:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f81f1ff/0xaa4c98508c499bd6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.062728:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179243.062731:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179243.062733:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788179243.063217:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788179243.063225:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c7fa8b1/0xaa4c98508c499bdd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.063236:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788179243.063239:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179243.063244:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c7fa8b1/0xaa4c98508c499bdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.063262:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c7fa8b1/0xaa4c98508c499bdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.063271:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c7fa8b1/0xaa4c98508c499bdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.063280:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c7fa8b1/0xaa4c98508c499bdd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.063298:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788179243.063307:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788179243.063313:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c7fa8b1/0xaa4c98508c499bdd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.063321:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c4c00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:2.0:1788179243.063325:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c7fa8b1/0xaa4c98508c499bdd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.063335:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c7fa8b1/0xaa4c98508c499bdd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.063348:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c7fa8b1/0xaa4c98508c499bdd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.063356:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c7fa8b1/0xaa4c98508c499bdd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.063376:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179243.063378:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179243.063379:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788179243.063904:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788179243.063911:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bac3eec/0xaa4c98508c499be4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.063921:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788179243.063925:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179243.063930:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bac3eec/0xaa4c98508c499be4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.063942:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bac3eec/0xaa4c98508c499be4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.063951:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bac3eec/0xaa4c98508c499be4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.063959:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004bac3eec/0xaa4c98508c499be4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.063975:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788179243.063984:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788179243.063989:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004bac3eec/0xaa4c98508c499be4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.064009:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c4800 already unused, calling callback (ffffffffc1644220) 00010000:00010000:2.0:1788179243.064013:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004bac3eec/0xaa4c98508c499be4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.064022:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004bac3eec/0xaa4c98508c499be4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.064034:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004bac3eec/0xaa4c98508c499be4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.064042:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bac3eec/0xaa4c98508c499be4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.064056:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179243.064058:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179243.064059:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788179243.065357:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788179243.065370:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b5856d0/0xaa4c98508c499beb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.065387:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788179243.065391:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179243.065397:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b5856d0/0xaa4c98508c499beb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.065410:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b5856d0/0xaa4c98508c499beb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.065426:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b5856d0/0xaa4c98508c499beb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.065434:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b5856d0/0xaa4c98508c499beb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.065459:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788179243.065666:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788179243.065675:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b5856d0/0xaa4c98508c499beb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.065686:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5a00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179243.065691:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b5856d0/0xaa4c98508c499beb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.065700:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b5856d0/0xaa4c98508c499beb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.065726:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b5856d0/0xaa4c98508c499beb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.065735:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b5856d0/0xaa4c98508c499beb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.065753:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179243.065755:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179243.065757:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788179243.066325:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788179243.066335:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c499bf2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.066346:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788179243.066350:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179243.066355:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c499bf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.066366:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c499bf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.066685:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c499bf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.066693:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c499bf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.066722:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788179243.066730:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788179243.066738:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c499bf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.066748:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5000 already unused, calling callback (ffffffffc1644220) 00010000:00010000:1.0:1788179243.066751:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c499bf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.066767:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c499bf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.066794:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c499bf2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.066802:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092b5c97e/0xaa4c98508c499bf2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.066829:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179243.066831:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179243.066834:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788179243.067651:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788179243.067659:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043efb9b3/0xaa4c98508c499bf9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.067671:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788179243.067674:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179243.067680:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043efb9b3/0xaa4c98508c499bf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.067695:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043efb9b3/0xaa4c98508c499bf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.067704:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043efb9b3/0xaa4c98508c499bf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.067712:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043efb9b3/0xaa4c98508c499bf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.067731:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788179243.067800:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788179243.067805:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043efb9b3/0xaa4c98508c499bf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.067813:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5e00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:2.0:1788179243.067823:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043efb9b3/0xaa4c98508c499bf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.067830:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043efb9b3/0xaa4c98508c499bf9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.067841:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043efb9b3/0xaa4c98508c499bf9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.067869:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043efb9b3/0xaa4c98508c499bf9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788179243.067888:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1788179243.067898:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179243.067901:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179243.067903:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788179243.070297:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788179243.070309:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bda46389/0xaa4c98508c499c00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.070326:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788179243.070330:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179243.070336:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bda46389/0xaa4c98508c499c00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.070350:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bda46389/0xaa4c98508c499c00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.070359:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bda46389/0xaa4c98508c499c00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.070374:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bda46389/0xaa4c98508c499c00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.070398:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788179243.070426:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788179243.070435:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bda46389/0xaa4c98508c499c00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.070446:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c5800 already unused, calling callback (ffffffffc1644220) 00010000:00010000:1.0:1788179243.070451:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bda46389/0xaa4c98508c499c00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.070462:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bda46389/0xaa4c98508c499c00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.070481:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bda46389/0xaa4c98508c499c00 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.070497:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bda46389/0xaa4c98508c499c00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.070520:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179243.070523:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179243.070526:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788179243.072998:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788179243.073084:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a53efa79/0xaa4c98508c499c07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.073103:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788179243.073108:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179243.073115:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a53efa79/0xaa4c98508c499c07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.073134:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a53efa79/0xaa4c98508c499c07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.073144:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a53efa79/0xaa4c98508c499c07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.073152:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a53efa79/0xaa4c98508c499c07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.073178:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788179243.073209:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788179243.073219:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a53efa79/0xaa4c98508c499c07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.073229:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9136c4a00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179243.073234:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a53efa79/0xaa4c98508c499c07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.073244:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a53efa79/0xaa4c98508c499c07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.073261:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a53efa79/0xaa4c98508c499c07 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.073269:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a53efa79/0xaa4c98508c499c07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.073304:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179243.073306:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179243.073308:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788179243.074121:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788179243.074129:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057f04d1b/0xaa4c98508c499c0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.074145:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788179243.074149:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179243.074155:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057f04d1b/0xaa4c98508c499c0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.074166:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057f04d1b/0xaa4c98508c499c0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.074175:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057f04d1b/0xaa4c98508c499c0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.074182:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057f04d1b/0xaa4c98508c499c0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.074210:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788179243.074781:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788179243.074802:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057f04d1b/0xaa4c98508c499c0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.074812:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920624a00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179243.074816:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057f04d1b/0xaa4c98508c499c0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788179243.074819:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788179243.074830:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d310628/0xaa4c98508c499c15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.074832:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057f04d1b/0xaa4c98508c499c0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.074872:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788179243.074886:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788179243.074891:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057f04d1b/0xaa4c98508c499c0e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.074892:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d310628/0xaa4c98508c499c15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.074913:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057f04d1b/0xaa4c98508c499c0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.074917:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d310628/0xaa4c98508c499c15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.074937:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179243.074941:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179243.074943:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179243.074945:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d310628/0xaa4c98508c499c15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.074954:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d310628/0xaa4c98508c499c15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.074976:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788179243.075029:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788179243.075034:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d310628/0xaa4c98508c499c15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.075052:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920624800 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179243.075056:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d310628/0xaa4c98508c499c15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.075063:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d310628/0xaa4c98508c499c15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.075073:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d310628/0xaa4c98508c499c15 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.075079:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d310628/0xaa4c98508c499c15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.075100:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179243.075102:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179243.075104:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788179243.076230:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788179243.076239:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf9321ac/0xaa4c98508c499c1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.076252:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788179243.076256:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179243.076262:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf9321ac/0xaa4c98508c499c1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.076273:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf9321ac/0xaa4c98508c499c1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.076282:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf9321ac/0xaa4c98508c499c1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.076289:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf9321ac/0xaa4c98508c499c1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.076332:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788179243.076897:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788179243.076906:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf9321ac/0xaa4c98508c499c1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.076916:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920625200 already unused, calling callback (ffffffffc1644220) 00010000:00010000:1.0:1788179243.076921:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf9321ac/0xaa4c98508c499c1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.076930:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf9321ac/0xaa4c98508c499c1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.076945:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf9321ac/0xaa4c98508c499c1c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.076954:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf9321ac/0xaa4c98508c499c1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.076983:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179243.076986:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179243.076989:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788179243.077087:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788179243.077094:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a534a127/0xaa4c98508c499c23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.077103:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788179243.077107:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179243.077112:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a534a127/0xaa4c98508c499c23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.077121:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a534a127/0xaa4c98508c499c23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.077130:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a534a127/0xaa4c98508c499c23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.077137:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a534a127/0xaa4c98508c499c23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.077162:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788179243.077472:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788179243.077478:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a534a127/0xaa4c98508c499c23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.077487:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920624600 already unused, calling callback (ffffffffc1644220) 00010000:00010000:1.0:1788179243.077491:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a534a127/0xaa4c98508c499c23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.077500:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a534a127/0xaa4c98508c499c23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.077514:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a534a127/0xaa4c98508c499c23 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.077522:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a534a127/0xaa4c98508c499c23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.077544:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179243.077547:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179243.077550:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788179243.077679:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788179243.077685:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb388202/0xaa4c98508c499c2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.077694:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788179243.077703:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179243.077708:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb388202/0xaa4c98508c499c2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.077718:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb388202/0xaa4c98508c499c2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.077726:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb388202/0xaa4c98508c499c2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.077733:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb388202/0xaa4c98508c499c2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.077826:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788179243.077896:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788179243.077902:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb388202/0xaa4c98508c499c2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.077910:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920625600 already unused, calling callback (ffffffffc1644220) 00010000:00010000:1.0:1788179243.077914:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb388202/0xaa4c98508c499c2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.077934:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb388202/0xaa4c98508c499c2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.077947:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb388202/0xaa4c98508c499c2a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.077953:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb388202/0xaa4c98508c499c2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.077970:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179243.077973:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179243.077976:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788179243.078376:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788179243.078383:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9231086/0xaa4c98508c499c31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.078392:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788179243.078395:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179243.078400:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9231086/0xaa4c98508c499c31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.078410:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9231086/0xaa4c98508c499c31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.078418:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9231086/0xaa4c98508c499c31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.078432:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9231086/0xaa4c98508c499c31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.078454:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788179243.078473:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788179243.078480:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9231086/0xaa4c98508c499c31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.078488:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920625a00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:1.0:1788179243.078492:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9231086/0xaa4c98508c499c31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.078499:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9231086/0xaa4c98508c499c31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.078512:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9231086/0xaa4c98508c499c31 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.078530:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9231086/0xaa4c98508c499c31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.078548:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179243.078550:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179243.078553:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788179243.079144:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788179243.079151:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c499c38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.079162:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788179243.079165:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179243.079169:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c499c38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.079178:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c499c38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.079185:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c499c38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.079191:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c499c38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.079216:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788179243.079719:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788179243.079725:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055276353/0xaa4c98508c499c3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.079807:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788179243.079811:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179243.079817:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055276353/0xaa4c98508c499c3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.079823:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788179243.079828:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055276353/0xaa4c98508c499c3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.079831:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c499c38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.079844:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055276353/0xaa4c98508c499c3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.079874:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920624c00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:1.0:1788179243.079889:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c499c38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.079890:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055276353/0xaa4c98508c499c3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.079913:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c499c38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.079925:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788179243.079928:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c499c38 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.079937:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c499c38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.079960:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788179243.079964:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055276353/0xaa4c98508c499c3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.079979:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920624e00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:1.0:1788179243.079983:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055276353/0xaa4c98508c499c3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.079991:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055276353/0xaa4c98508c499c3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.080003:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055276353/0xaa4c98508c499c3f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.080009:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055276353/0xaa4c98508c499c3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.080024:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179243.080026:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179243.080027:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179243.080135:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788179243.080688:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788179243.080695:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017cedf63/0xaa4c98508c499c46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.080705:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788179243.080709:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179243.080714:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017cedf63/0xaa4c98508c499c46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.080724:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017cedf63/0xaa4c98508c499c46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.080893:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017cedf63/0xaa4c98508c499c46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.080900:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017cedf63/0xaa4c98508c499c46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.080917:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788179243.080928:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788179243.080936:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017cedf63/0xaa4c98508c499c46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.080944:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920625400 already unused, calling callback (ffffffffc1644220) 00010000:00010000:1.0:1788179243.080948:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017cedf63/0xaa4c98508c499c46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.080956:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017cedf63/0xaa4c98508c499c46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.080978:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017cedf63/0xaa4c98508c499c46 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.080986:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017cedf63/0xaa4c98508c499c46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.081007:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179243.081010:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179243.081012:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788179243.081488:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788179243.081494:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b14f37ec/0xaa4c98508c499c4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.081504:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788179243.081507:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179243.081511:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b14f37ec/0xaa4c98508c499c4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.081519:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b14f37ec/0xaa4c98508c499c4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.081526:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b14f37ec/0xaa4c98508c499c4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.081534:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b14f37ec/0xaa4c98508c499c4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.081570:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788179243.081608:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788179243.081615:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b14f37ec/0xaa4c98508c499c4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.081624:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920624200 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179243.081628:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b14f37ec/0xaa4c98508c499c4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.081650:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b14f37ec/0xaa4c98508c499c4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.081663:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b14f37ec/0xaa4c98508c499c4d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.081673:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b14f37ec/0xaa4c98508c499c4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.081696:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179243.081698:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179243.081701:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788179243.082180:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788179243.082186:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000328bc55a/0xaa4c98508c499c54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.082194:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788179243.082197:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179243.082201:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000328bc55a/0xaa4c98508c499c54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.082210:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000328bc55a/0xaa4c98508c499c54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.082217:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000328bc55a/0xaa4c98508c499c54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.082225:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000328bc55a/0xaa4c98508c499c54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.082244:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788179243.082871:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788179243.082888:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000328bc55a/0xaa4c98508c499c54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.082897:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920625000 already unused, calling callback (ffffffffc1644220) 00010000:00010000:1.0:1788179243.082902:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000328bc55a/0xaa4c98508c499c54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.082910:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000328bc55a/0xaa4c98508c499c54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.082924:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000328bc55a/0xaa4c98508c499c54 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.082931:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000328bc55a/0xaa4c98508c499c54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.082971:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179243.082973:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179243.082974:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788179243.084072:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788179243.084082:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089bcd65e/0xaa4c98508c499c5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.084098:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=439s v=(0 0) 00010000:00010000:1.0:1788179243.084102:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179243.084110:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089bcd65e/0xaa4c98508c499c5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.084122:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089bcd65e/0xaa4c98508c499c5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.084130:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089bcd65e/0xaa4c98508c499c5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.084137:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089bcd65e/0xaa4c98508c499c5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.084155:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788179243.084715:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788179243.084723:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089bcd65e/0xaa4c98508c499c5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.084732:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc918381400 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179243.084736:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089bcd65e/0xaa4c98508c499c5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.084746:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089bcd65e/0xaa4c98508c499c5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.084763:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089bcd65e/0xaa4c98508c499c5b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.084783:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089bcd65e/0xaa4c98508c499c5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179243.084806:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179243.084808:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179243.084810:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788179243.086045:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788179243.086056:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009298b5ae/0xaa4c98508c499c62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.086071:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788179243.086081:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179243.086087:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009298b5ae/0xaa4c98508c499c62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.086101:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009298b5ae/0xaa4c98508c499c62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.086110:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009298b5ae/0xaa4c98508c499c62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.086117:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009298b5ae/0xaa4c98508c499c62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.086142:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788179243.086187:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788179243.086195:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009298b5ae/0xaa4c98508c499c62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.086226:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920625800 already unused, calling callback (ffffffffc1644220) 00010000:00010000:1.0:1788179243.086231:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009298b5ae/0xaa4c98508c499c62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.086239:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009298b5ae/0xaa4c98508c499c62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.086256:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009298b5ae/0xaa4c98508c499c62 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.086264:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009298b5ae/0xaa4c98508c499c62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.086293:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179243.086296:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179243.086297:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788179243.086819:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788179243.086825:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c499c69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.086835:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788179243.086839:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179243.086843:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c499c69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.086873:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c499c69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.086893:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c499c69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.086909:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c499c69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.086931:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788179243.087589:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788179243.087596:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc82211e/0xaa4c98508c499c70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.087606:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788179243.087609:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179243.087614:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc82211e/0xaa4c98508c499c70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.087624:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc82211e/0xaa4c98508c499c70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.087632:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc82211e/0xaa4c98508c499c70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.087640:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc82211e/0xaa4c98508c499c70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179243.087654:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1788179243.088093:0:14907:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1788179243.088197:0:14907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc80361a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14297:x1875041472052608:12345-0@lo:5:osp-pre-0-0.0 Request processed in 76138us (76200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179243.088217:0:14907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788179243.088295:0:14297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc80361b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14297:1875041472052608:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788179243.088316:0:14297:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1788179243.088371:0:14297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc90703b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14297:1875041472052736:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788179243.088703:0:14297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179243.089158:0:14297:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc918601900 going to sleep for 11 seconds 00000100:00100000:2.0:1788179243.089193:0:14908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472052736 00000100:00100000:2.0:1788179243.089201:0:14908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472052736 00000100:00100000:2.0:1788179243.089247:0:14908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788179243.089257:0:14908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14297:x1875041472052736:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788179243.089305:0:14908:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:1.0:1788179243.090545:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788179243.090557:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c499c69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.090572:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920625c00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:1.0:1788179243.090577:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c499c69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.090588:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c499c69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.090619:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c499c69 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.090626:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c499c69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.090659:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788179243.090664:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc82211e/0xaa4c98508c499c70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.090671:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920624000 already unused, calling callback (ffffffffc1644220) 00010000:00010000:1.0:1788179243.090675:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc82211e/0xaa4c98508c499c70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.090683:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc82211e/0xaa4c98508c499c70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.090694:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc82211e/0xaa4c98508c499c70 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.090701:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc82211e/0xaa4c98508c499c70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179243.090720:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179243.090722:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179243.090731:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179243.090946:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788179243.097381:0:14908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14297:x1875041472052736:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8119us (8950us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788179243.097395:0:14908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788179243.097528:0:14297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc90703b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14297:1875041472052736:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788179243.097546:0:14297:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1788179243.716307:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788179244.732931:0:15579:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788179244.732936:0:15579:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788179244.733066:0:15579:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9bc905c14800 00000020:01000004:2.0:1788179244.733083:0:15579:0:(tgt_mount.c:2577:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788179244.733096:0:15579:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788179244.733112:0:15579:0:(genops.c:414:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9bc93b67b380) 00000020:00000080:2.0:1788179244.733140:0:15579:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00010000:00010000:1.0:1788179244.737448:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788179244.759671:0:15579:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788179244.761958:0:15579:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788179244.763164:0:15579:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788179244.763450:0:15579:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788179244.763663:0:15579:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788179244.765554:0:15579:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 287: rc = 0 00100000:10000000:1.0:1788179244.765656:0:15579:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 287: rc = 0 00100000:10000000:1.0:1788179244.765771:0:15579:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 287: rc = 0 00100000:10000000:1.0:1788179244.766530:0:15579:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 646: rc = 0 00100000:10000000:1.0:1788179244.767255:0:15579:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 646: rc = 0 00100000:10000000:1.0:1788179244.767520:0:15579:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 646: rc = 0 00100000:10000000:1.0:1788179244.767842:0:15579:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 646: rc = 0 00100000:10000000:1.0:1788179244.768399:0:15579:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 646: rc = 0 00100000:10000000:1.0:1788179244.773796:0:15579:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 646: rc = 0 00000020:00000080:1.0:1788179244.775128:0:15579:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788179244.775149:0:15579:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788179244.775173:0:15579:0:(genops.c:1407:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xaa4c98508c499c7e 00000020:01000004:1.0:1788179244.775183:0:15579:0:(tgt_mount.c:2662:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788179244.775315:0:15579:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.102@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788179244.775320:0:15579:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788179244.775326:0:15579:0:(tgt_mount.c:1875:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788179244.775369:0:15579:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1788179244.775373:0:15579:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.102@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788179244.785440:0:15579:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.102@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788179244.785493:0:15579:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.102@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788179244.785499:0:15579:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788179244.785501:0:15579:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788179244.785502:0:15579:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788179244.785503:0:15579:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788179244.785505:0:15579:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788179244.785506:0:15579:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788179244.785507:0:15579:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788179244.785509:0:15579:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788179244.785511:0:15579:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788179244.785515:0:15579:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788179244.785518:0:15579:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788179244.785519:0:15579:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788179244.785520:0:15579:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788179244.785521:0:15579:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788179244.785522:0:15579:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788179244.785524:0:15579:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788179244.785525:0:15579:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788179244.785526:0:15579:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788179244.785527:0:15579:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788179244.785554:0:15579:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788179244.785575:0:15579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803601180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472052864:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788179244.785649:0:15579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179244.785718:0:15579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e49d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788179244.785840:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472052864 00000100:00100000:0.0:1788179244.785877:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472052864 00000100:00100000:1.0:1788179244.786023:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788179244.786109:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+16:15579:x1875041472052864:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788179244.786148:0:14268:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788179244.786152:0:14268:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788179244.786156:0:14268:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788179244.802195:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+16:15579:x1875041472052864:12345-0@lo:253:mount.lustre.0 Request processed in 16153us (16535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179244.802212:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788179244.802302:0:15579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803601180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472052864:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788179244.802319:0:15579:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788179244.802323:0:15579:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788179244.802325:0:15579:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788179244.802326:0:15579:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788179244.802328:0:15579:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788179244.802329:0:15579:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788179244.802331:0:15579:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788179244.802332:0:15579:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788179244.802334:0:15579:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788179244.802336:0:15579:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788179244.802360:0:15579:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9bc905c14800 from lustre-OST0001 10000000:01000000:3.0:1788179244.802414:0:15579:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788179244.802417:0:15579:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788179244.802426:0:15579:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9bc9265c19c0 local copy 00010000:00010000:3.0:1788179244.802438:0:15579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317e400/0xaa4c98508c499a2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499a32 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179244.802662:0:15579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803618000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472052992:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788179244.802701:0:15579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179244.802783:0:15579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc926544540 going to sleep for 11 seconds 00000100:00100000:2.0:1788179244.802828:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472052992 00000100:00100000:2.0:1788179244.802834:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472052992 00000100:00100000:2.0:1788179244.803097:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788179244.803113:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+16:15579:x1875041472052992:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788179244.803345:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+16:15579:x1875041472052992:12345-0@lo:501:mount.lustre.0 Request processed in 233us (643us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788179244.803353:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788179244.803429:0:15579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803618000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472052992:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788179244.803452:0:15579:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788179244.803649:0:15579:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788179244.803656:0:15579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc91317e400/0xaa4c98508c499a2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499a32 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179244.803676:0:15579:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc91317e400/0xaa4c98508c499a2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499a32 expref: -99 pid: 14255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788179244.803697:0:15579:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9bc905c14800 10000000:01000000:1.0:1788179244.803703:0:15579:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788179244.803708:0:15579:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788179244.803711:0:15579:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788179244.803715:0:15579:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788179244.803717:0:15579:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788179244.803741:0:15579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc918381e00/0xaa4c98508c499c85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179244.803748:0:15579:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc918381e00/0xaa4c98508c499c85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179244.803757:0:15579:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc918381e00/0xaa4c98508c499c85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179244.803772:0:15579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803601180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472053120:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788179244.803801:0:15579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179244.803969:0:15579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e49dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788179244.804110:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472053120 00000100:00100000:3.0:1788179244.804116:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472053120 00000100:00100000:3.0:1788179244.804148:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788179244.804154:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+16:15579:x1875041472053120:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788179244.804164:0:14269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179244.804182:0:14269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9137b5c00/0xaa4c98508c499c8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c499c85 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179244.804207:0:14269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9137b5c00/0xaa4c98508c499c8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c499c85 expref: 17 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179244.804216:0:14269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9137b5c00/0xaa4c98508c499c8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c499c85 expref: 17 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179244.804231:0:14269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b5c00, rc 0) 00000100:00100000:3.0:1788179244.804298:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+17:15579:x1875041472053120:12345-0@lo:101:mount.lustre.0 Request processed in 143us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179244.804304:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788179244.804376:0:15579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803601180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472053120:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788179244.804388:0:15579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc918381e00/0xaa4c98508c499c85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499c8c expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179244.804397:0:15579:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc918381e00/0xaa4c98508c499c85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c499c8c expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788179244.806254:0:15579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788179244.807496:0:15579:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788179244.807767:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788179244.807814:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788179244.808156:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788179244.808226:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788179244.808264:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788179244.808301:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788179244.808525:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788179244.808536:0:15579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788179244.808641:0:15579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a23100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472053248:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788179244.808709:0:15579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179244.808798:0:15579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc918352a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788179244.809043:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472053248 00000100:00100000:3.0:1788179244.809051:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472053248 00000100:00100000:3.0:1788179244.809154:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788179244.809167:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+17:15579:x1875041472053248:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788179244.809570:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+17:15579:x1875041472053248:12345-0@lo:501:mount.lustre.0 Request processed in 406us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179244.809578:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788179244.809657:0:15579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a23100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472053248:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788179244.809690:0:15579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a23100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472053376:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788179244.809736:0:15579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179244.812142:0:15579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc918352a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788179244.812458:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472053376 00000100:00100000:2.0:1788179244.812467:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472053376 00000100:00100000:2.0:1788179244.812511:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788179244.812520:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+17:15579:x1875041472053376:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788179244.812988:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+17:15579:x1875041472053376:12345-0@lo:503:mount.lustre.0 Request processed in 468us (3250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179244.812996:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788179244.813207:0:15579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a23100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472053376:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788179244.813732:0:15579:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788179244.813816:0:15579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a23100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472053504:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788179244.814025:0:15579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179244.814098:0:15579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc918352a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788179244.814152:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472053504 00000100:00100000:2.0:1788179244.814158:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472053504 00000100:00100000:2.0:1788179244.814253:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788179244.814262:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+17:15579:x1875041472053504:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788179244.814462:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+17:15579:x1875041472053504:12345-0@lo:502:mount.lustre.0 Request processed in 200us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179244.814469:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788179244.814641:0:15579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a23100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472053504:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788179244.814985:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788179244.815056:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788179244.815095:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788179244.815184:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788179244.815225:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788179244.815261:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788179244.815337:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788179244.815379:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788179244.815428:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788179244.815461:0:15579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803601180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472053632:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788179244.815509:0:15579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179244.815703:0:15579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e49de40 going to sleep for 11 seconds 00000100:00100000:3.0:1788179244.815784:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472053632 00000100:00100000:3.0:1788179244.815791:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472053632 00000100:00100000:3.0:1788179244.815820:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788179244.815828:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+17:15579:x1875041472053632:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788179244.816069:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+17:15579:x1875041472053632:12345-0@lo:502:mount.lustre.0 Request processed in 241us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179244.816077:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788179244.816167:0:15579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803601180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472053632:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788179244.816228:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788179244.816238:0:15579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788179244.817220:0:15581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788179244.817229:0:15581:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788179244.817236:0:15581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788179244.817239:0:15581:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788179244.817244:0:15581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788179244.817261:0:15581:0:(genops.c:414:class_newdev()) Allocate new device lustre-OST0001 (ffff9bc93fb38000) 00000020:00000080:1.0:1788179244.817287:0:15581:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788179244.817293:0:15581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788179244.817370:0:15581:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bc905c14800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788179244.817377:0:15581:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788179244.817384:0:15581:0:(genops.c:1407:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xaa4c98508c499c9a 00010000:00010000:1.0:1788179244.821796:0:15581:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788179244.822971:0:15581:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1788179244.824649:0:15581:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788179244.825987:0:15581:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788179244.825999:0:15581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788179244.826013:0:15581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788179244.826015:0:15581:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788179244.826019:0:15581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788179244.826023:0:15581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788179244.826025:0:15581:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788179244.826033:0:15581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788179244.826035:0:15581:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788179244.826038:0:15581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788179244.826041:0:15581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788179244.826042:0:15581:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788179244.826044:0:15581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788179244.826047:0:15581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788179244.826048:0:15581:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788179244.826052:0:15581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788179244.826118:0:15581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788179244.826128:0:15581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788179244.826129:0:15581:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788179244.826133:0:15581:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788179244.828965:0:15579:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788179244.829008:0:15579:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788179244.829037:0:15579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc918381e00/0xaa4c98508c499c85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499c8c expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179244.829052:0:15579:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc918381e00/0xaa4c98508c499c85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499c8c expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788179244.829061:0:15579:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bc905c14800 from 1 10000000:01000000:3.0:1788179244.829063:0:15579:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788179244.829111:0:15579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5400/0xaa4c98508c499ca1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179244.829119:0:15579:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5400/0xaa4c98508c499ca1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179244.829130:0:15579:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5400/0xaa4c98508c499ca1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179244.829165:0:15579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc80361aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472053760:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788179244.829225:0:15579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179244.829262:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472053760 00000100:00100000:3.0:1788179244.829275:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472053760 00000100:00100000:3.0:1788179244.829325:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788179244.829334:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+17:15579:x1875041472053760:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788179244.829346:0:14269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179244.829357:0:14269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9137b5800/0xaa4c98508c499ca8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c499ca1 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179244.829379:0:14269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9137b5800/0xaa4c98508c499ca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c499ca1 expref: 18 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179244.829389:0:14269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9137b5800/0xaa4c98508c499ca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c499ca1 expref: 18 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179244.829397:0:14269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b5800, rc 0) 00000100:00100000:3.0:1788179244.829423:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+18:15579:x1875041472053760:12345-0@lo:101:mount.lustre.0 Request processed in 91us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179244.829430:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788179244.829470:0:15579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc926544840 going to sleep for 11 seconds 00000100:00100000:3.0:1788179244.829487:0:15579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc80361aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472053760:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788179244.829499:0:15579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5400/0xaa4c98508c499ca1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499ca8 expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179244.829507:0:15579:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5400/0xaa4c98508c499ca1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c499ca8 expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788179244.830078:0:15579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788179244.830681:0:15579:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788179244.830947:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788179244.830986:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788179244.831038:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788179244.831046:0:15579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788179244.831123:0:15579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc80361aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472053888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788179244.831171:0:15579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179244.831196:0:15579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc926544840 going to sleep for 11 seconds 00000100:00100000:0.0:1788179244.833458:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472053888 00000100:00100000:0.0:1788179244.833472:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472053888 00000100:00100000:0.0:1788179244.833515:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788179244.833523:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+18:15579:x1875041472053888:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788179244.834931:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+18:15579:x1875041472053888:12345-0@lo:501:mount.lustre.0 Request processed in 1404us (3754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179244.834943:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788179244.835706:0:15579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc80361aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472053888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788179244.835776:0:15579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc90703a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472054016:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788179244.835842:0:15579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179244.835914:0:15579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9201453c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788179244.835981:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472054016 00000100:00100000:0.0:1788179244.835988:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472054016 00000100:00100000:0.0:1788179244.836038:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788179244.836049:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+18:15579:x1875041472054016:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788179244.836254:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+18:15579:x1875041472054016:12345-0@lo:503:mount.lustre.0 Request processed in 206us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179244.836261:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788179244.836379:0:15579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc90703a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472054016:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788179244.837168:0:15579:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788179244.837241:0:15579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc90703a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472054144:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788179244.837294:0:15579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179244.837327:0:15579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9201453c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788179244.837394:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472054144 00000100:00100000:0.0:1788179244.837401:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472054144 00000100:00100000:0.0:1788179244.837445:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788179244.837453:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+18:15579:x1875041472054144:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788179244.837603:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+18:15579:x1875041472054144:12345-0@lo:502:mount.lustre.0 Request processed in 151us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179244.837616:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788179244.837719:0:15579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc90703a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472054144:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788179244.838151:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788179244.838203:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788179244.838254:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788179244.838293:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788179244.838328:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788179244.838383:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788179244.838420:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788179244.838453:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788179244.838486:0:15579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc90703a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472054272:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788179244.838530:0:15579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179244.838566:0:15579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9201453c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788179244.839157:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472054272 00000100:00100000:0.0:1788179244.839167:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472054272 00000100:00100000:0.0:1788179244.839214:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788179244.839224:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+18:15579:x1875041472054272:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788179244.839412:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+18:15579:x1875041472054272:12345-0@lo:502:mount.lustre.0 Request processed in 190us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179244.839420:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788179244.839504:0:15579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc90703a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472054272:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788179244.839619:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788179244.839631:0:15579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788179244.840575:0:15585:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788179244.840586:0:15585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788179244.840589:0:15585:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788179244.840597:0:15585:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bc905c14800 00000020:00000080:3.0:1788179244.840599:0:15585:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788179244.840607:0:15585:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788179244.840610:0:15585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788179244.840611:0:15585:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788179244.840614:0:15585:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788179244.840616:0:15585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788179244.840617:0:15585:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788179244.840620:0:15585:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9bc905c14800 00000020:00000080:3.0:1788179244.840622:0:15585:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788179244.840715:0:15585:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788179244.840720:0:15585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788179244.840721:0:15585:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788179244.840724:0:15585:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788179244.840733:0:15585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788179244.840735:0:15585:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788179244.840740:0:15585:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9bc905c14800 00000020:00000080:3.0:1788179244.840742:0:15585:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788179244.850238:0:15585:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788179244.850257:0:15585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788179244.850259:0:15585:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788179244.850266:0:15585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788179244.850460:0:15579:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788179244.850492:0:15579:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788179244.850523:0:15579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5400/0xaa4c98508c499ca1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499ca8 expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179244.850541:0:15579:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5400/0xaa4c98508c499ca1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499ca8 expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788179244.850592:0:15579:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788179244.850595:0:15579:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9bc905c14800 10000000:01000000:3.0:1788179244.850598:0:15579:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9bc905c14800 10000000:01000000:3.0:1788179244.850602:0:15579:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788179244.850613:0:15579:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9bc905c14800 from 1 10000000:01000000:3.0:1788179244.850616:0:15579:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788179244.850657:0:15579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4400/0xaa4c98508c499caf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179244.850667:0:15579:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4400/0xaa4c98508c499caf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179244.850683:0:15579:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4400/0xaa4c98508c499caf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179244.850709:0:15579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc80361ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472054400:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788179244.850789:0:15579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179244.850835:0:15579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc926544540 going to sleep for 11 seconds 00000100:00100000:1.0:1788179244.857009:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472054400 00000100:00100000:1.0:1788179244.857034:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472054400 00000100:00100000:1.0:1788179244.857330:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788179244.857343:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+18:15579:x1875041472054400:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788179244.857361:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179244.857381:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc918380a00/0xaa4c98508c499cb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c499caf expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179244.857410:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc918380a00/0xaa4c98508c499cb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c499caf expref: 19 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179244.857438:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc918380a00/0xaa4c98508c499cb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c499caf expref: 19 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179244.857448:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc918380a00, rc 0) 00000100:00100000:1.0:1788179244.857554:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+19:15579:x1875041472054400:12345-0@lo:101:mount.lustre.0 Request processed in 214us (6763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179244.857561:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788179244.863510:0:15579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc80361ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472054400:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788179244.863538:0:15579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4400/0xaa4c98508c499caf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499cb6 expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179244.863551:0:15579:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4400/0xaa4c98508c499caf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c499cb6 expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788179244.874609:0:15579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788179244.875182:0:15579:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788179244.875448:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788179244.875493:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788179244.875529:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788179244.875581:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788179244.875617:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788179244.875665:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788179244.875700:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788179244.875735:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788179244.875785:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788179244.875823:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788179244.878147:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788179244.878295:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788179244.878332:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788179244.878364:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788179244.878412:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788179244.878446:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788179244.878478:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788179244.878522:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788179244.878555:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788179244.878586:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788179244.878642:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788179244.878679:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788179244.878712:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788179244.878762:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788179244.878799:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788179244.878832:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788179244.880374:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788179244.880430:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788179244.880460:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788179244.880506:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1788179244.880540:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1788179244.880574:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1788179244.880607:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1788179244.880650:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1788179244.880684:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1788179244.880735:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1788179244.880774:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1788179244.882263:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1788179244.882278:0:15579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1788179244.882377:0:15579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc80361ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472054528:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788179244.882443:0:15579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179244.883944:0:15579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc903589a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788179244.886060:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472054528 00000100:00100000:2.0:1788179244.886074:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472054528 00000100:00100000:2.0:1788179244.886131:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788179244.886141:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+19:15579:x1875041472054528:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788179244.886443:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+19:15579:x1875041472054528:12345-0@lo:501:mount.lustre.0 Request processed in 303us (3999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179244.886451:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788179244.886932:0:15579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc80361ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472054528:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788179244.886986:0:15579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc80361ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472054656:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788179244.887036:0:15579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179244.887076:0:15579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc903589a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788179244.887174:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472054656 00000100:00100000:1.0:1788179244.887180:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472054656 00000100:00100000:1.0:1788179244.887328:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788179244.887337:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+19:15579:x1875041472054656:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788179244.887608:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+19:15579:x1875041472054656:12345-0@lo:503:mount.lustre.0 Request processed in 272us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179244.887616:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788179244.887770:0:15579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc80361ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472054656:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788179244.888270:0:15579:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788179244.888343:0:15579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc80361ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472054784:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788179244.888398:0:15579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179244.888430:0:15579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc903589a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788179244.888499:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472054784 00000100:00100000:2.0:1788179244.888505:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472054784 00000100:00100000:2.0:1788179244.888543:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788179244.888550:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+19:15579:x1875041472054784:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788179244.888976:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+19:15579:x1875041472054784:12345-0@lo:502:mount.lustre.0 Request processed in 426us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179244.888994:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788179244.889118:0:15579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc80361ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472054784:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788179244.889340:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788179244.889388:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788179244.889423:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788179244.889470:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788179244.889507:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788179244.889557:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788179244.889594:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788179244.889625:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788179244.889674:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788179244.889712:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788179244.889749:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788179244.889800:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788179244.889839:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788179244.889919:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788179244.889989:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788179244.890027:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788179244.890063:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788179244.890112:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788179244.890150:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788179244.890185:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788179244.890237:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788179244.890272:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788179244.890309:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788179244.890361:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788179244.890398:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788179244.890435:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788179244.890484:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788179244.890521:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788179244.890565:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788179244.890614:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788179244.890668:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788179244.890705:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788179244.890741:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788179244.890791:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788179244.890830:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788179244.890923:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788179244.890960:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788179244.890997:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788179244.891046:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788179244.891082:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788179244.891127:0:15579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc80361ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472054912:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788179244.891199:0:15579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179244.891234:0:15579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc903589a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788179244.892084:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472054912 00000100:00100000:2.0:1788179244.892093:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472054912 00000100:00100000:2.0:1788179244.892143:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788179244.892152:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+19:15579:x1875041472054912:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788179244.892465:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+19:15579:x1875041472054912:12345-0@lo:502:mount.lustre.0 Request processed in 313us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179244.892474:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788179244.892606:0:15579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc80361ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472054912:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788179244.892705:0:15579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788179244.892720:0:15579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788179244.894092:0:15590:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788179244.894112:0:15590:0:(genops.c:414:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9bc93fb3b380) 00000020:00000080:1.0:1788179244.894136:0:15590:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1788179244.894321:0:15590:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9bc905c14800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788179244.894326:0:15590:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9bc905c14800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788179244.894329:0:15590:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9bc905c14800 3 00010000:00080000:1.0:1788179244.894362:0:15590:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9bc90928e000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.102@tcp at head 00010000:00010000:1.0:1788179244.896009:0:15590:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1788179244.896110:0:15590:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788179244.896145:0:15590:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788179244.896159:0:15590:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xaa4c98508c499cc4 00000100:00080000:1.0:1788179244.896168:0:15590:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788179244.896173:0:15590:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9bc90928e000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:1.0:1788179244.896216:0:15590:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bc803601180 x1875041472055040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788179244.896253:0:15590:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788179244.898377:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875041472055040:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788179244.898465:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179244.898534:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472055040 00000100:00100000:0.0:1788179244.898544:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472055040 00000100:00100000:0.0:1788179244.898579:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788179244.898586:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1875041472055040:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788179244.898612:0:14276:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:0.0:1788179244.898652:0:14276:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xaa4c98508c499ccb 00000004:00100000:0.0:1788179244.898666:0:14276:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788179244.898704:0:14276:0:(import.c:65:import_set_state_nolock()) ffff9bc80394f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788179244.898765:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875041472055040:12345-0@lo:38:llog_process_th.0 Request processed in 177us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179244.898772:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788179244.900813:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc803601180 x1875041472055040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788179254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179244.900829:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788179244.900841:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788179244.900885:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788179244.900891:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788179244.900894:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9bc90928e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788179244.900902:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1875041472055040:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788179244.901555:0:15590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00080000:3.0:1788179244.902014:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788179244.902020:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788179244.902023:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bc910edd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788179244.902028:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 439 00000100:00080000:3.0:1788179244.902043:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788179244.902049:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bc910edd000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:3.0:1788179244.902071:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bc80361bb80 x1875041472055296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788179244.902132:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472055168:0@lo:400:kworker.0 00000100:00100000:3.0:1788179244.902196:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179244.902244:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc80361bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875041472055296:0@lo:8:kworker.0 00000100:00100000:3.0:1788179244.902270:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179244.902297:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc80361b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041472055424:0@lo:400:kworker.0 00000100:00100000:3.0:1788179244.902324:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179244.902344:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788179244.902349:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041472055552:0@lo:400:kworker.0 00000100:00100000:3.0:1788179244.902369:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179244.902408:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472055168 00000100:00100000:3.0:1788179244.902415:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472055168 00000100:00100000:3.0:1788179244.902452:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472055296 00000100:00100000:3.0:1788179244.902456:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472055296 00000100:00100000:3.0:1788179244.902468:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788179244.902478:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803619880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1875041472055168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179244.902530:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803619880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1875041472055168:12345-0@lo:400:kworker.0 Request processed in 53us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179244.902537:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788179244.902552:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788179244.902557:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803618700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1875041472055296:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788179244.902600:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803618700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1875041472055296:12345-0@lo:8:kworker.0 Request processed in 41us (328us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788179244.902617:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788179244.902634:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472055424 00000100:00100000:3.0:1788179244.902638:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472055424 00000100:00100000:3.0:1788179244.902661:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472055552 00000100:00100000:3.0:1788179244.902663:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472055552 00000100:00100000:3.0:1788179244.902677:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788179244.902684:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc80361ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041472055424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179244.902718:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc80361ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041472055424:12345-0@lo:400:kworker.0 Request processed in 35us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179244.902724:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788179244.902736:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788179244.902742:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc80361aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041472055552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179244.902769:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc80361aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875041472055552:12345-0@lo:400:kworker.0 Request processed in 27us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179244.902774:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788179244.902814:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788179244.902821:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9bc910edd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788179244.902824:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788179244.902827:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc80361bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875041472055296:0@lo:8:kworker.0 00000020:01000000:0.0:1788179244.903183:0:15579:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788179244.903224:0:15579:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00080000:3.0:1788179244.903320:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc803619f80 x1875041472055552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179244.903331:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1875041472055552:0@lo:400:kworker.0 00010000:00080000:3.0:1788179244.903342:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9bc80361b800 x1875041472055424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179244.903350:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc80361b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041472055424:0@lo:400:kworker.0 00000100:00100000:3.0:1788179244.903407:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472055168:0@lo:400:kworker.0 00010000:00010000:0.0:1788179244.903446:0:15579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4400/0xaa4c98508c499caf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499cb6 expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179244.903456:0:15579:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc9137b4400/0xaa4c98508c499caf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499cb6 expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788179244.903500:0:15579:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788179244.903502:0:15579:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788179244.903504:0:15579:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788179244.903505:0:15579:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788179244.903506:0:15579:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788179244.903507:0:15579:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788179244.903509:0:15579:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788179244.903511:0:15579:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788179244.903513:0:15579:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788179244.903516:0:15579:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788179244.903519:0:15579:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788179244.903520:0:15579:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788179244.903521:0:15579:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788179244.903522:0:15579:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788179244.903523:0:15579:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788179244.903524:0:15579:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788179244.903525:0:15579:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788179244.903526:0:15579:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788179244.903527:0:15579:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788179244.903544:0:15579:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788179244.903557:0:15579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a23b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472055680:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788179244.903596:0:15579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179244.903635:0:15579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc907091180 going to sleep for 11 seconds 00000100:00100000:3.0:1788179244.907754:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472055680 00000100:00100000:3.0:1788179244.907769:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472055680 00000100:00100000:3.0:1788179244.907829:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788179244.907840:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+19:15579:x1875041472055680:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788179244.907905:0:14269:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788179244.907919:0:14269:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788179244.938749:0:14269:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788179244.938778:0:14269:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788179244.938899:0:14290:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788179244.938904:0:14290:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788179244.938927:0:14290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bc9137b4e00/0xaa4c98508c499cd2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179244.938944:0:14290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499bac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c499ba5 expref: 19 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179244.938953:0:14290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bc9137b4e00/0xaa4c98508c499cd2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179244.938995:0:14290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499bac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c499ba5 expref: 19 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179244.939011:0:14290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499bac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c499ba5 expref: 19 pid: 14266 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179244.939026:0:14290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803619500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14290:1875041472055808:0@lo:104: 00000100:00100000:3.0:1788179244.939090:0:14290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179244.939139:0:14290:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9266e3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788179244.940588:0:14256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472055808 00000100:00100000:2.0:1788179244.940601:0:14256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472055808 00000100:00100000:2.0:1788179244.940661:0:14256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788179244.940671:0:14256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc80361b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce136049-9565-40c1-979f-49dcc63d6657+3:14290:x1875041472055808:12345-0@lo:104: 00010000:00010000:2.0:1788179244.940687:0:14256:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c499ba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c499bac expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179244.940782:0:14256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788179244.940788:0:14256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc80361b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce136049-9565-40c1-979f-49dcc63d6657+3:14290:x1875041472055808:12345-0@lo:104: Request processed in 119us (1699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179244.940795:0:14256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788179244.940819:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788179244.940825:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c499ba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c499bac expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179244.940834:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317e200 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:2.0:1788179244.940838:0:14261:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c499ba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c499bac expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179244.940898:0:14261:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c499ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c499bac expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788179244.940906:0:14261:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c499ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c499bac expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788179244.940913:0:14261:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788179244.940949:0:14261:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c499ba5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c499bac expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179244.940957:0:14261:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788179244.940976:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c499ba5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c499bac expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179244.940984:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc91317e200/0xaa4c98508c499ba5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c499bac expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179244.940999:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179244.941001:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179244.941003:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179244.941120:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc90703a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce136049-9565-40c1-979f-49dcc63d6657:3307:1875041472055936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788179244.941159:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179244.941237:0:14290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803619500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14290:1875041472055808:0@lo:104: 00010000:00010000:3.0:1788179244.941258:0:14290:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bc9137b4e00/0xaa4c98508c499cd2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179244.941471:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472055936 00000100:00100000:2.0:1788179244.941476:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472055936 00010000:00010000:2.0:1788179244.941499:0:14260:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499bac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c499ba5 expref: 20 pid: 14266 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179244.941532:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788179244.941539:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803619f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce136049-9565-40c1-979f-49dcc63d6657+20:3307:x1875041472055936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788179244.941550:0:14260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179244.941555:0:14260:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499bac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c499ba5 expref: 20 pid: 14266 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179244.941573:0:14260:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499bac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c499ba5 expref: 20 pid: 14266 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179244.941588:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc942173c00/0xaa4c98508c499bac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c499ba5 expref: 20 pid: 14266 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179244.941602:0:14260:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bc9137b4e00/0xaa4c98508c499cd2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179244.941610:0:14260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9137b4e00/0xaa4c98508c499cd2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788179244.941624:0:14260:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003860985s 00010000:00010000:2.0:1788179244.941628:0:14260:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bc9137b4e00/0xaa4c98508c499cd2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179244.941635:0:14260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bc9137b4e00/0xaa4c98508c499cd2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179244.941641:0:14260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bc9137b4e00/0xaa4c98508c499cd2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179244.941648:0:14260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bc9137b4e00/0xaa4c98508c499cd2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179244.941654:0:14260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4e00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:2.0:1788179244.941658:0:14260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bc9137b4e00/0xaa4c98508c499cd2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179244.941665:0:14260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bc9137b4e00/0xaa4c98508c499cd2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179244.941691:0:14260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bc9137b4e00/0xaa4c98508c499cd2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179244.941701:0:14260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788179244.941735:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803619f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce136049-9565-40c1-979f-49dcc63d6657+19:3307:x1875041472055936:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179244.941742:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788179244.941952:0:14290:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bc9137b4e00/0xaa4c98508c499cd2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179244.941961:0:14290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bc9137b4e00/0xaa4c98508c499cd2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179244.941968:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc9137b4e00/0xaa4c98508c499cd2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179244.942164:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc90703a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce136049-9565-40c1-979f-49dcc63d6657:3307:1875041472055936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788179244.947524:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+18:15579:x1875041472055680:12345-0@lo:253:mount.lustre.0 Request processed in 39677us (43917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179244.947541:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788179244.947626:0:15579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a23b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce136049-9565-40c1-979f-49dcc63d6657:15579:1875041472055680:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788179244.947641:0:15579:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788179244.947658:0:15579:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788179244.947659:0:15579:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788179244.947661:0:15579:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788179244.947662:0:15579:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788179244.947664:0:15579:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788179244.947665:0:15579:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788179244.947666:0:15579:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788179244.947668:0:15579:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788179244.947669:0:15579:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788179244.947690:0:15579:0:(tgt_mount.c:2766:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788179244.951637:0:15579:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788179244.951845:0:15579:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788179244.952467:0:15579:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788179244.952635:0:15579:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788179244.952800:0:15579:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788179244.953208:0:15579:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788179244.954473:0:15579:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788179244.992732:0:15579:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788179244.992743:0:15579:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788179244.992790:0:15579:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788179244.992896:0:15579:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.102@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788179244.992917:0:15579:0:(tgt_mount.c:2535:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788179244.992949:0:15579:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788179245.763143:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788179246.393516:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1788179246.393568:0:6618:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 10000000:01000000:2.0:1788179246.657411:0:14271:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788179246.657424:0:14271:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9bc93f796000 from 8 10000000:01000000:2.0:1788179246.657433:0:14271:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788179246.657513:0:14271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc920624e00/0xaa4c98508c499cd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179246.657530:0:14271:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc920624e00/0xaa4c98508c499cd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179246.657543:0:14271:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc920624e00/0xaa4c98508c499cd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179246.657596:0:14271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc907038a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472056064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788179246.657694:0:14271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179246.657780:0:14271:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93f960b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788179246.657997:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472056064 00000100:00100000:3.0:1788179246.658016:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472056064 00000100:00100000:3.0:1788179246.658092:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788179246.658104:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+18:14271:x1875041472056064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788179246.658123:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179246.658155:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9137b5a00/0xaa4c98508c499ce0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c499cd9 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179246.658393:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9137b5a00/0xaa4c98508c499ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c499cd9 expref: 19 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179246.658408:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9137b5a00/0xaa4c98508c499ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c499cd9 expref: 19 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179246.658420:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b5a00, rc 0) 00000100:00100000:3.0:1788179246.658529:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+19:14271:x1875041472056064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 427us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179246.658536:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788179246.658774:0:14271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc907038a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472056064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788179246.658796:0:14271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc920624e00/0xaa4c98508c499cd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499ce0 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179246.658807:0:14271:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc920624e00/0xaa4c98508c499cd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c499ce0 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179246.659021:0:14271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a23b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472056192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788179246.659071:0:14271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179246.659111:0:14271:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9359ea6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788179246.659323:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472056192 00000100:00100000:3.0:1788179246.659329:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472056192 00000100:00100000:3.0:1788179246.659366:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788179246.659375:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+19:14271:x1875041472056192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788179246.659398:0:14269:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788179246.659415:0:14269:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788179246.659419:0:14269:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788179246.659526:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+19:14271:x1875041472056192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 152us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179246.659535:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788179246.659553:0:14271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a23b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472056192:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788179246.659729:0:14271:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788179246.659741:0:14271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc920624e00/0xaa4c98508c499cd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499ce0 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179246.659820:0:14271:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc920624e00/0xaa4c98508c499cd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499ce0 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179246.785408:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179247.809363:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179248.322486:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc907039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472056320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788179248.322568:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179248.322678:0:14912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472056320 00000100:00100000:0.0:1788179248.322688:0:14912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472056320 00000100:00100000:0.0:1788179248.322787:0:14912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788179248.322801:0:14912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472056320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788179248.322906:0:14912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788179248.324003:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788179248.325338:0:14912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472056320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2535us (2763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179248.325354:0:14912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788179248.325544:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788179248.325571:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc907039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472056320:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788179248.832943:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788179249.358388:0:14308:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788179249.856102:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788179250.371652:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788179250.371660:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788179250.371663:0:37:0:(import.c:65:import_set_state_nolock()) ffff9bc910edd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788179250.371676:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9bc910edd000 using connection 192.168.202.102@tcp/0@lo 00000100:00100000:3.0:1788179250.371697:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9bc80361b480 x1875041472056704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788179250.371758:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc80361bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce136049-9565-40c1-979f-49dcc63d6657:3305:1875041472056448:0@lo:400:kworker.0 00000100:00100000:3.0:1788179250.371845:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179250.371916:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875041472057088:0@lo:400:kworker.0 00000100:00100000:3.0:1788179250.371946:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179250.371975:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788179250.371981:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472056576:0@lo:400:kworker.0 00000100:00100000:3.0:1788179250.372005:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179250.372035:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc80361b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875041472056704:0@lo:8:kworker.0 00000100:00100000:3.0:1788179250.372074:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179250.372101:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041472056832:0@lo:400:kworker.0 00000100:00100000:3.0:1788179250.372125:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179250.372347:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788179250.372360:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875041472056960:0@lo:400:kworker.0 00000100:00100000:3.0:1788179250.372387:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179250.372423:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472056448 00000100:00100000:3.0:1788179250.372430:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472056448 00000100:00100000:3.0:1788179250.372477:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788179250.372486:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc926561050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+19:3305:x1875041472056448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179250.372536:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc926561050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+19:3305:x1875041472056448:12345-0@lo:400:kworker.0 Request processed in 51us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179250.372543:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788179250.372575:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472057088 00000100:00100000:3.0:1788179250.372579:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472057088 00000100:00100000:3.0:1788179250.372619:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472056832 00000100:00100000:3.0:1788179250.372623:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472056832 00000100:00100000:3.0:1788179250.372634:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472056960 00000100:00100000:3.0:1788179250.372636:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472056960 00000100:00100000:3.0:1788179250.372651:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788179250.372657:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875041472057088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179250.372691:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875041472057088:12345-0@lo:400:kworker.0 Request processed in 33us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179250.372697:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788179250.372709:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788179250.372714:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041472056832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179250.372746:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041472056832:12345-0@lo:400:kworker.0 Request processed in 32us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179250.372761:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788179250.372776:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788179250.372782:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875041472056960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179250.372823:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875041472056960:12345-0@lo:400:kworker.0 Request processed in 41us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179250.372829:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788179250.372847:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472056576 00000100:00100000:3.0:1788179250.372870:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472056576 00000100:00100000:3.0:1788179250.372893:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472056704 00000100:00100000:3.0:1788179250.372896:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472056704 00000100:00100000:3.0:1788179250.372904:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788179250.372911:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472056576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179250.372939:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472056576:12345-0@lo:400:kworker.0 Request processed in 29us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179250.372945:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788179250.372956:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788179250.372960:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1875041472056704:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788179250.372983:0:14910:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:3.0:1788179250.373013:0:14910:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xaa4c98508c499ce7 00002000:00100000:3.0:1788179250.373027:0:14910:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9bc80358e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211371b ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788179250.373031:0:14910:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788179250.373034:0:14910:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788179250.374884:0:14910:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788179250.374914:0:14910:0:(import.c:65:import_set_state_nolock()) ffff9bc80358e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788179250.374992:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1875041472056704:12345-0@lo:8:kworker.0 Request processed in 2029us (2915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179250.375014:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788179250.375904:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc80361b480 x1875041472056704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788179275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788179250.375923:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788179250.375933:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788179250.376086:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788179250.376091:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9bc910edd000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788179250.376109:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788179250.376115:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc80361b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1875041472056704:0@lo:8:kworker.0 00000004:00080000:2.0:1788179250.376121:0:14298:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:3.0:1788179250.376160:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8d7100 x1875041472056960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179250.376170:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875041472056960:0@lo:400:kworker.0 00010000:00080000:3.0:1788179250.376184:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc803618e00 x1875041472056832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179250.376193:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041472056832:0@lo:400:kworker.0 00000100:00100000:3.0:1788179250.376229:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472056576:0@lo:400:kworker.0 00000100:00100000:3.0:1788179250.376240:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc80361bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce136049-9565-40c1-979f-49dcc63d6657:3305:1875041472056448:0@lo:400:kworker.0 00010000:00080000:3.0:1788179250.376253:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc92e8d6300 x1875041472057088/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788179266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788179250.376262:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875041472057088:0@lo:400:kworker.0 00000004:00080000:0.0:1788179250.376334:0:14299:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1788179250.376356:0:14299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a22d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14299:1875041472057344:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788179250.376408:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472057216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788179250.376412:0:14299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179250.376435:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179250.376435:0:14299:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9359ea180 going to sleep for 11 seconds 00000100:00100000:0.0:1788179250.376452:0:14907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472057344 00000100:00100000:0.0:1788179250.376458:0:14907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472057344 00000100:00100000:0.0:1788179250.376498:0:14907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788179250.376507:0:14907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14299:x1875041472057344:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:1.0:1788179250.377092:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788179250.377098:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788179250.377102:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788179250.377114:0:14911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472057216 00000100:00100000:1.0:1788179250.377121:0:14911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472057216 00000100:00100000:1.0:1788179250.377154:0:14911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788179250.377161:0:14911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875041472057216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788179250.377187:0:14911:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788179250.377245:0:14911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875041472057216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179250.377252:0:14911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788179250.377610:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9bc935a20e00 x1875041472057216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788179266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788179250.377631:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472057216:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1788179250.377898:0:14298:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 446441046896ns, next at 0ns, rc = 0 00002000:00080000:0.0:1788179250.380346:0:14907:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788179250.380357:0:14907:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788179250.380362:0:14907:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:0.0:1788179250.392109:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788179250.392121:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2fd2451/0xaa4c98508c499cee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.392139:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1788179250.392144:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788179250.392151:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2fd2451/0xaa4c98508c499cee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.392168:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2fd2451/0xaa4c98508c499cee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.392186:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2fd2451/0xaa4c98508c499cee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.392194:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2fd2451/0xaa4c98508c499cee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.392216:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788179250.392229:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788179250.392235:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2fd2451/0xaa4c98508c499cee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.392243:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317e800 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179250.392247:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2fd2451/0xaa4c98508c499cee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.392256:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2fd2451/0xaa4c98508c499cee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.392272:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2fd2451/0xaa4c98508c499cee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.392279:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2fd2451/0xaa4c98508c499cee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.392296:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179250.392304:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179250.392306:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788179250.394628:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788179250.394640:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e98a9c3/0xaa4c98508c499cf5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.394662:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788179250.394666:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179250.394672:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e98a9c3/0xaa4c98508c499cf5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.394687:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e98a9c3/0xaa4c98508c499cf5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.394697:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e98a9c3/0xaa4c98508c499cf5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.394705:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e98a9c3/0xaa4c98508c499cf5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.394719:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788179250.394984:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788179250.394992:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e98a9c3/0xaa4c98508c499cf5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.395003:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc918380000 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179250.395008:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e98a9c3/0xaa4c98508c499cf5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.395017:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e98a9c3/0xaa4c98508c499cf5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.395034:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e98a9c3/0xaa4c98508c499cf5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.395041:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e98a9c3/0xaa4c98508c499cf5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.395059:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179250.395061:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179250.395063:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788179250.396671:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788179250.396681:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7f6a0d6/0xaa4c98508c499cfc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.396693:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788179250.396696:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179250.396700:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7f6a0d6/0xaa4c98508c499cfc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.396711:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7f6a0d6/0xaa4c98508c499cfc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.396731:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7f6a0d6/0xaa4c98508c499cfc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.396739:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7f6a0d6/0xaa4c98508c499cfc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.396763:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788179250.396790:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788179250.396797:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7f6a0d6/0xaa4c98508c499cfc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.396819:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc918381c00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179250.396824:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7f6a0d6/0xaa4c98508c499cfc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.396839:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7f6a0d6/0xaa4c98508c499cfc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.396874:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7f6a0d6/0xaa4c98508c499cfc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.396882:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7f6a0d6/0xaa4c98508c499cfc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.396898:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179250.396899:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179250.396902:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788179250.399443:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788179250.399456:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f8c8ce4/0xaa4c98508c499d03 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.399472:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788179250.399476:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179250.399482:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f8c8ce4/0xaa4c98508c499d03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.399495:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f8c8ce4/0xaa4c98508c499d03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.399504:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f8c8ce4/0xaa4c98508c499d03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.399511:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f8c8ce4/0xaa4c98508c499d03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.399539:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788179250.399844:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788179250.399876:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f8c8ce4/0xaa4c98508c499d03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.399884:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc918381800 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179250.399889:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f8c8ce4/0xaa4c98508c499d03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.399897:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f8c8ce4/0xaa4c98508c499d03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.399915:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f8c8ce4/0xaa4c98508c499d03 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.399933:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f8c8ce4/0xaa4c98508c499d03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.399963:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179250.399965:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179250.399966:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788179250.401991:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788179250.402003:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee180527/0xaa4c98508c499d0a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.402019:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788179250.402023:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179250.402029:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee180527/0xaa4c98508c499d0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.402042:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee180527/0xaa4c98508c499d0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.402050:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee180527/0xaa4c98508c499d0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.402058:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee180527/0xaa4c98508c499d0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.402075:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788179250.405329:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788179250.405342:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6dfa92b/0xaa4c98508c499d11 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.405362:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788179250.405375:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179250.405383:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6dfa92b/0xaa4c98508c499d11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.405398:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6dfa92b/0xaa4c98508c499d11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.405408:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6dfa92b/0xaa4c98508c499d11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.405416:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6dfa92b/0xaa4c98508c499d11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.405445:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788179250.405876:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788179250.405882:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089bcd65e/0xaa4c98508c499d18 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.405891:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788179250.405894:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179250.405898:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089bcd65e/0xaa4c98508c499d18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.405907:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089bcd65e/0xaa4c98508c499d18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.405914:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089bcd65e/0xaa4c98508c499d18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.405926:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089bcd65e/0xaa4c98508c499d18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.405933:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788179250.406278:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788179250.406284:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040547e8/0xaa4c98508c499d1f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.406292:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788179250.406294:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179250.406298:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000040547e8/0xaa4c98508c499d1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.406306:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000040547e8/0xaa4c98508c499d1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.406314:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000040547e8/0xaa4c98508c499d1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.406321:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000040547e8/0xaa4c98508c499d1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.406329:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788179250.406682:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788179250.406688:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f896dbf5/0xaa4c98508c499d26 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.406701:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788179250.406704:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179250.406708:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f896dbf5/0xaa4c98508c499d26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.406716:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f896dbf5/0xaa4c98508c499d26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.406723:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f896dbf5/0xaa4c98508c499d26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.406730:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f896dbf5/0xaa4c98508c499d26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.406738:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788179250.407163:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788179250.407170:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003314ddd3/0xaa4c98508c499d2d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.407179:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788179250.407183:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179250.407186:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003314ddd3/0xaa4c98508c499d2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.407196:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003314ddd3/0xaa4c98508c499d2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.407215:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003314ddd3/0xaa4c98508c499d2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.407223:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003314ddd3/0xaa4c98508c499d2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.407232:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1788179250.407615:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788179250.407622:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000128545a5/0xaa4c98508c499d34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.407631:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788179250.407634:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179250.407638:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000128545a5/0xaa4c98508c499d34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.407648:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000128545a5/0xaa4c98508c499d34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.407656:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000128545a5/0xaa4c98508c499d34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.407664:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000128545a5/0xaa4c98508c499d34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.407683:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:0.0:1788179250.408925:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788179250.408937:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee180527/0xaa4c98508c499d0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.408949:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc918381000 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179250.408954:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee180527/0xaa4c98508c499d0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.408964:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee180527/0xaa4c98508c499d0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.408982:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee180527/0xaa4c98508c499d0a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.408990:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee180527/0xaa4c98508c499d0a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409013:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788179250.409017:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6dfa92b/0xaa4c98508c499d11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409035:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc918380200 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179250.409038:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6dfa92b/0xaa4c98508c499d11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409046:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6dfa92b/0xaa4c98508c499d11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409055:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6dfa92b/0xaa4c98508c499d11 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409061:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6dfa92b/0xaa4c98508c499d11 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409073:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788179250.409076:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089bcd65e/0xaa4c98508c499d18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409082:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc918381400 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179250.409085:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089bcd65e/0xaa4c98508c499d18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409092:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089bcd65e/0xaa4c98508c499d18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409099:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089bcd65e/0xaa4c98508c499d18 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409110:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089bcd65e/0xaa4c98508c499d18 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409123:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788179250.409127:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000040547e8/0xaa4c98508c499d1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409133:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc918380e00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179250.409136:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000040547e8/0xaa4c98508c499d1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409144:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000040547e8/0xaa4c98508c499d1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409153:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000040547e8/0xaa4c98508c499d1f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409159:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000040547e8/0xaa4c98508c499d1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409171:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788179250.409174:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f896dbf5/0xaa4c98508c499d26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409180:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc918380400 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179250.409189:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f896dbf5/0xaa4c98508c499d26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409197:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f896dbf5/0xaa4c98508c499d26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409207:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f896dbf5/0xaa4c98508c499d26 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409214:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f896dbf5/0xaa4c98508c499d26 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409226:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788179250.409230:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003314ddd3/0xaa4c98508c499d2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409235:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc918380800 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179250.409238:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003314ddd3/0xaa4c98508c499d2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409245:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003314ddd3/0xaa4c98508c499d2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409253:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003314ddd3/0xaa4c98508c499d2d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409259:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003314ddd3/0xaa4c98508c499d2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409283:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788179250.409287:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000128545a5/0xaa4c98508c499d34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409293:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc918381200 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179250.409296:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000128545a5/0xaa4c98508c499d34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409304:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000128545a5/0xaa4c98508c499d34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409313:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000128545a5/0xaa4c98508c499d34 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409320:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000128545a5/0xaa4c98508c499d34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.409331:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179250.409333:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179250.409335:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179250.409342:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788179250.415129:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788179250.415224:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd73b01b/0xaa4c98508c499d3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.415242:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788179250.415247:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179250.415254:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd73b01b/0xaa4c98508c499d3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.415269:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd73b01b/0xaa4c98508c499d3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.415279:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd73b01b/0xaa4c98508c499d3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.415288:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd73b01b/0xaa4c98508c499d3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.415313:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788179250.415732:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788179250.415737:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f58a11a/0xaa4c98508c499d42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.415745:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788179250.415753:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179250.415757:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f58a11a/0xaa4c98508c499d42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.415765:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f58a11a/0xaa4c98508c499d42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.415773:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f58a11a/0xaa4c98508c499d42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.415780:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f58a11a/0xaa4c98508c499d42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.415793:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788179250.418578:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788179250.418596:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000729a048/0xaa4c98508c499d49 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.418616:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788179250.418621:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179250.418628:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000729a048/0xaa4c98508c499d49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.418642:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000729a048/0xaa4c98508c499d49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.418654:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000729a048/0xaa4c98508c499d49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.418674:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000729a048/0xaa4c98508c499d49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.418686:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788179250.420350:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788179250.420363:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd73b01b/0xaa4c98508c499d3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.420375:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc918380600 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179250.420387:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd73b01b/0xaa4c98508c499d3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.420398:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd73b01b/0xaa4c98508c499d3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.420417:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd73b01b/0xaa4c98508c499d3b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.420424:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd73b01b/0xaa4c98508c499d3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.420455:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788179250.420459:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f58a11a/0xaa4c98508c499d42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.420465:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc918381600 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179250.420468:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f58a11a/0xaa4c98508c499d42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.420476:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f58a11a/0xaa4c98508c499d42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.420485:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f58a11a/0xaa4c98508c499d42 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.420493:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f58a11a/0xaa4c98508c499d42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.420514:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788179250.420518:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000729a048/0xaa4c98508c499d49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.420525:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc918381a00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179250.420528:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000729a048/0xaa4c98508c499d49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.420536:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000729a048/0xaa4c98508c499d49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.420546:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000729a048/0xaa4c98508c499d49 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.420553:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000729a048/0xaa4c98508c499d49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.420565:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179250.420567:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179250.420569:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179250.420575:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788179250.421641:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788179250.421651:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007687d7f/0xaa4c98508c499d50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.421664:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788179250.421669:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179250.421675:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007687d7f/0xaa4c98508c499d50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.421687:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007687d7f/0xaa4c98508c499d50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.421694:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007687d7f/0xaa4c98508c499d50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.421700:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007687d7f/0xaa4c98508c499d50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.421716:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788179250.425383:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788179250.425397:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ecfae82/0xaa4c98508c499d57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.425419:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788179250.425423:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179250.425430:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ecfae82/0xaa4c98508c499d57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.425444:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ecfae82/0xaa4c98508c499d57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.425454:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ecfae82/0xaa4c98508c499d57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.425462:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ecfae82/0xaa4c98508c499d57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.425484:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788179250.425922:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788179250.425929:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6d00320/0xaa4c98508c499d5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.425938:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788179250.425941:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179250.425945:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6d00320/0xaa4c98508c499d5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.425954:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6d00320/0xaa4c98508c499d5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.425975:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6d00320/0xaa4c98508c499d5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.425982:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6d00320/0xaa4c98508c499d5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.425991:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788179250.426372:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788179250.426378:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4330e83/0xaa4c98508c499d65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.426387:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788179250.426390:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179250.426394:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4330e83/0xaa4c98508c499d65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.426404:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4330e83/0xaa4c98508c499d65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.426411:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4330e83/0xaa4c98508c499d65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.426418:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4330e83/0xaa4c98508c499d65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.426438:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788179250.426832:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788179250.426838:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b28c5b34/0xaa4c98508c499d6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.426872:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788179250.426876:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179250.426880:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b28c5b34/0xaa4c98508c499d6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.426890:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b28c5b34/0xaa4c98508c499d6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.426898:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b28c5b34/0xaa4c98508c499d6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.426905:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b28c5b34/0xaa4c98508c499d6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.426913:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788179250.427303:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788179250.427308:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b26f25c/0xaa4c98508c499d73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.427316:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788179250.427324:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179250.427328:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b26f25c/0xaa4c98508c499d73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.427337:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b26f25c/0xaa4c98508c499d73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.427344:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b26f25c/0xaa4c98508c499d73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.427350:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b26f25c/0xaa4c98508c499d73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.427357:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1788179250.427728:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788179250.427735:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7a50a21/0xaa4c98508c499d7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.427744:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788179250.427747:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179250.427751:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7a50a21/0xaa4c98508c499d7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.427759:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7a50a21/0xaa4c98508c499d7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.427766:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7a50a21/0xaa4c98508c499d7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.427779:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7a50a21/0xaa4c98508c499d7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.427787:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:2.0:1788179250.428171:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788179250.428181:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007687d7f/0xaa4c98508c499d50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.428191:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc918380c00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:2.0:1788179250.428197:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007687d7f/0xaa4c98508c499d50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.428206:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007687d7f/0xaa4c98508c499d50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.428239:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007687d7f/0xaa4c98508c499d50 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.428247:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007687d7f/0xaa4c98508c499d50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.428279:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788179250.428283:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ecfae82/0xaa4c98508c499d57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.428289:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92f7cf400 already unused, calling callback (ffffffffc1644220) 00010000:00010000:2.0:1788179250.428293:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ecfae82/0xaa4c98508c499d57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.428300:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ecfae82/0xaa4c98508c499d57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.428311:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ecfae82/0xaa4c98508c499d57 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.428319:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ecfae82/0xaa4c98508c499d57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.428341:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788179250.428345:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6d00320/0xaa4c98508c499d5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.428356:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92f7ce200 already unused, calling callback (ffffffffc1644220) 00010000:00010000:2.0:1788179250.428359:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6d00320/0xaa4c98508c499d5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.428366:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6d00320/0xaa4c98508c499d5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.428376:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6d00320/0xaa4c98508c499d5e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.428383:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6d00320/0xaa4c98508c499d5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.428421:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788179250.428428:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4330e83/0xaa4c98508c499d65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.428436:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92f7cf000 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179250.428446:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4330e83/0xaa4c98508c499d65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.428448:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788179250.428454:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4330e83/0xaa4c98508c499d65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.428465:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4330e83/0xaa4c98508c499d65 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.428472:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4330e83/0xaa4c98508c499d65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.428496:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788179250.428499:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b26f25c/0xaa4c98508c499d73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.428505:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92f7cfc00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179250.428507:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b26f25c/0xaa4c98508c499d73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.428514:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b26f25c/0xaa4c98508c499d73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.428522:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b26f25c/0xaa4c98508c499d73 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.428529:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b26f25c/0xaa4c98508c499d73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.428545:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788179250.428548:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7a50a21/0xaa4c98508c499d7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.428554:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92f7ce000 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179250.428557:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7a50a21/0xaa4c98508c499d7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.428564:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7a50a21/0xaa4c98508c499d7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.428574:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7a50a21/0xaa4c98508c499d7a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.428581:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7a50a21/0xaa4c98508c499d7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.428592:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179250.428594:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179250.428596:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179250.428846:0:15878:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179250.428868:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b28c5b34/0xaa4c98508c499d6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.428875:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92f7cf800 already unused, calling callback (ffffffffc1644220) 00010000:00010000:2.0:1788179250.428879:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b28c5b34/0xaa4c98508c499d6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.428887:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b28c5b34/0xaa4c98508c499d6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.428908:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b28c5b34/0xaa4c98508c499d6c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.428915:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b28c5b34/0xaa4c98508c499d6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.428928:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179250.428929:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179250.428931:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179250.428948:0:15878:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179250.428950:0:15878:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788179250.433336:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788179250.433349:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d960ac5/0xaa4c98508c499d81 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.433374:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788179250.433379:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179250.433386:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d960ac5/0xaa4c98508c499d81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.433402:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d960ac5/0xaa4c98508c499d81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.433412:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d960ac5/0xaa4c98508c499d81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.433419:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d960ac5/0xaa4c98508c499d81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.433436:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788179250.433824:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788179250.433830:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d0cb286/0xaa4c98508c499d88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.433845:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788179250.433865:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179250.433869:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d0cb286/0xaa4c98508c499d88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.433878:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788179250.433879:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d0cb286/0xaa4c98508c499d88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.433885:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d960ac5/0xaa4c98508c499d81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.433886:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d0cb286/0xaa4c98508c499d88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.433895:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d0cb286/0xaa4c98508c499d88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.433895:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92f7ce400 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179250.433906:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d960ac5/0xaa4c98508c499d81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.433907:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788179250.434332:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788179250.434339:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d0cb286/0xaa4c98508c499d88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.434348:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92f7cfe00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:2.0:1788179250.434351:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d0cb286/0xaa4c98508c499d88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.434360:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d0cb286/0xaa4c98508c499d88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.434378:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d0cb286/0xaa4c98508c499d88 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.434386:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d0cb286/0xaa4c98508c499d88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.434414:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179250.434415:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179250.434417:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179250.434549:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d960ac5/0xaa4c98508c499d81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.434560:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d960ac5/0xaa4c98508c499d81 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.434568:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d960ac5/0xaa4c98508c499d81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.434582:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179250.434584:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179250.434585:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788179250.435359:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788179250.435369:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005eb38783/0xaa4c98508c499d8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.435380:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788179250.435383:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179250.435388:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005eb38783/0xaa4c98508c499d8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.435399:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005eb38783/0xaa4c98508c499d8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.435420:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005eb38783/0xaa4c98508c499d8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.435428:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005eb38783/0xaa4c98508c499d8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.435452:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788179250.437399:0:15878:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788179250.437414:0:15878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005eb38783/0xaa4c98508c499d8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.437426:0:15878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92f7cea00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:2.0:1788179250.437431:0:15878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005eb38783/0xaa4c98508c499d8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.437440:0:15878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005eb38783/0xaa4c98508c499d8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.437459:0:15878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005eb38783/0xaa4c98508c499d8f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.437466:0:15878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005eb38783/0xaa4c98508c499d8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179250.437487:0:15878:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179250.437489:0:15878:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179250.437491:0:15878:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788179250.438080:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788179250.438089:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0c400f4/0xaa4c98508c499d96 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.438102:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788179250.438106:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179250.438112:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0c400f4/0xaa4c98508c499d96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.438124:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0c400f4/0xaa4c98508c499d96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.438132:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0c400f4/0xaa4c98508c499d96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.438215:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0c400f4/0xaa4c98508c499d96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.438242:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1788179250.439731:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788179250.442373:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788179250.442386:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9c08b46/0xaa4c98508c499d9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.442405:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788179250.442410:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179250.442417:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9c08b46/0xaa4c98508c499d9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.442430:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9c08b46/0xaa4c98508c499d9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.442440:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9c08b46/0xaa4c98508c499d9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.442448:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9c08b46/0xaa4c98508c499d9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.442522:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788179250.442964:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788179250.442970:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b67a8739/0xaa4c98508c499da4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.442980:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788179250.442990:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179250.442994:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b67a8739/0xaa4c98508c499da4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.443004:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b67a8739/0xaa4c98508c499da4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.443012:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b67a8739/0xaa4c98508c499da4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.443019:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b67a8739/0xaa4c98508c499da4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.447036:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788179250.447052:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0c400f4/0xaa4c98508c499d96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.447068:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92f7ce800 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179250.447074:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0c400f4/0xaa4c98508c499d96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.447085:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0c400f4/0xaa4c98508c499d96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.447107:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0c400f4/0xaa4c98508c499d96 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.447126:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0c400f4/0xaa4c98508c499d96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.447159:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788179250.447163:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9c08b46/0xaa4c98508c499d9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.447170:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92f7cf200 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179250.447174:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9c08b46/0xaa4c98508c499d9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.447181:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9c08b46/0xaa4c98508c499d9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.447192:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9c08b46/0xaa4c98508c499d9d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.447200:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9c08b46/0xaa4c98508c499d9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.447213:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788179250.447216:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b67a8739/0xaa4c98508c499da4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.447222:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92f7ce600 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179250.447232:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b67a8739/0xaa4c98508c499da4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.447241:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b67a8739/0xaa4c98508c499da4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.447252:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b67a8739/0xaa4c98508c499da4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.447260:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179250.447262:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179250.447264:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179250.447339:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788179250.447347:0:14907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b67a8739/0xaa4c98508c499da4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788179250.448012:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788179250.448020:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044ce788c/0xaa4c98508c499dab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.448033:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788179250.448038:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179250.448045:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044ce788c/0xaa4c98508c499dab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.448058:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044ce788c/0xaa4c98508c499dab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.448075:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044ce788c/0xaa4c98508c499dab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.448083:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044ce788c/0xaa4c98508c499dab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179250.448097:0:14907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788179250.448266:0:14907:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:1.0:1788179250.448362:0:14907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14299:x1875041472057344:12345-0@lo:5:osp-pre-1-0.0 Request processed in 71851us (71944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179250.448376:0:14907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788179250.448475:0:14262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788179250.448481:0:14262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044ce788c/0xaa4c98508c499dab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.448490:0:14262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92f7cf600 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179250.448493:0:14262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044ce788c/0xaa4c98508c499dab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.448502:0:14262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044ce788c/0xaa4c98508c499dab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.448515:0:14262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044ce788c/0xaa4c98508c499dab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.448522:0:14262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044ce788c/0xaa4c98508c499dab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179250.448546:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179250.448548:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179250.448550:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179250.448588:0:14299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a22d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14299:1875041472057344:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788179250.448604:0:14299:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1788179250.448651:0:14299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a22d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14299:1875041472057472:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788179250.448687:0:14299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179250.448731:0:14299:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc907091840 going to sleep for 11 seconds 00010000:00010000:0.0:1788179250.448743:0:15878:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179250.448956:0:14908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472057472 00000100:00100000:1.0:1788179250.448964:0:14908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472057472 00000100:00100000:1.0:1788179250.449007:0:14908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788179250.449015:0:14908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14299:x1875041472057472:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788179250.449053:0:14908:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:2.0:1788179250.454940:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179250.457618:0:14908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14299:x1875041472057472:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8596us (8922us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788179250.457631:0:14908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788179250.458034:0:14299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a22d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14299:1875041472057472:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788179250.458052:0:14299:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1788179250.880788:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788179251.089606:0:15934:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg202-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788179251.905137:0:15878:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788179252.927999:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179253.348272:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179253.348443:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451090048 00000100:00100000:2.0:1788179253.348454:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451090048 00000100:00100000:2.0:1788179253.348517:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 74 00000100:00100000:2.0:1788179253.348526:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc926562050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2353:x1875041451090048:12345-192.168.202.2@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788179253.348791:0:14268:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda@192.168.202.2@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:2.0:1788179253.348831:0:14268:0:(genops.c:1407:class_connect()) connect: client f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda, cookie 0xaa4c98508c499db2 00000100:00080000:2.0:1788179253.349096:0:14268:0:(import.c:65:import_set_state_nolock()) ffff9bc802a02000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788179253.349233:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc926562050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+5:2353:x1875041451090048:12345-192.168.202.2@tcp:250:mount.lustre.0 Request processed in 705us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179253.349242:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 74 00000100:00100000:2.0:1788179253.357952:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179253.358361:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451090176 00000100:00100000:3.0:1788179253.358372:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451090176 00000100:00100000:3.0:1788179253.358431:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 75 00000100:00100000:3.0:1788179253.358441:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc926563c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+5:13701:x1875041451090176:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788179253.358457:0:14269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179253.358487:0:14269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc9137b4600/0xaa4c98508c499db9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x34c7c42474662352 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179253.358516:0:14269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc9137b4600/0xaa4c98508c499db9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662352 expref: 6 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179253.358527:0:14269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc9137b4600/0xaa4c98508c499db9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662352 expref: 6 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179253.358537:0:14269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4600, rc 0) 00000100:00100000:3.0:1788179253.358791:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc926563c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+6:13701:x1875041451090176:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 351us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179253.358799:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 75 00000100:00100000:1.0:1788179253.402232:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179253.402519:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451090304 00000100:00100000:2.0:1788179253.402531:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451090304 00000100:00100000:2.0:1788179253.402603:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 76 00000100:00100000:2.0:1788179253.402613:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc926561850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+6:13701:x1875041451090304:12345-192.168.202.2@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788179253.403164:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc926561850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+6:13701:x1875041451090304:12345-192.168.202.2@tcp:501:mount.lustre.0 Request processed in 550us (941us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788179253.404107:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 76 00000100:00100000:1.0:1788179253.406475:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179253.406586:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451090432 00000100:00100000:0.0:1788179253.406597:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451090432 00000100:00100000:0.0:1788179253.406650:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 77 00000100:00100000:0.0:1788179253.406661:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc926561450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+6:13701:x1875041451090432:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788179253.406677:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179253.406705:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc91317e600/0xaa4c98508c499dc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x34c7c42474662359 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179253.406736:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc91317e600/0xaa4c98508c499dc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662359 expref: 7 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179253.406746:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc91317e600/0xaa4c98508c499dc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662359 expref: 7 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179253.406756:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317e600, rc 0) 00000100:00100000:0.0:1788179253.406838:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc926561450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+7:13701:x1875041451090432:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 178us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179253.406846:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 77 00000100:00100000:3.0:1788179253.412361:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179253.412707:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451090560 00000100:00100000:2.0:1788179253.412719:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451090560 00000100:00100000:2.0:1788179253.412773:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 78 00000100:00100000:2.0:1788179253.412792:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e79dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+7:13701:x1875041451090560:12345-192.168.202.2@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788179253.413157:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e79dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+8:13701:x1875041451090560:12345-192.168.202.2@tcp:501:mount.lustre.0 Request processed in 365us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179253.413624:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 78 00000100:00100000:1.0:1788179253.417986:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179253.420815:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451090688 00000100:00100000:3.0:1788179253.420830:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451090688 00000100:00100000:3.0:1788179253.420947:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 79 00000100:00100000:3.0:1788179253.420958:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e79f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+8:13701:x1875041451090688:12345-192.168.202.2@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788179253.421253:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e79f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+8:13701:x1875041451090688:12345-192.168.202.2@tcp:503:mount.lustre.0 Request processed in 295us (3277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179253.421262:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 79 00000100:00100000:1.0:1788179253.434828:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179253.435193:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451090816 00000100:00100000:0.0:1788179253.435203:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451090816 00000100:00100000:0.0:1788179253.435255:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 80 00000100:00100000:0.0:1788179253.435265:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e79cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+8:13719:x1875041451090816:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788179253.435593:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e79cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+8:13719:x1875041451090816:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 328us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179253.435601:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 80 00000100:00100000:3.0:1788179253.440667:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc90703b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472057600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788179253.440766:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179253.441091:0:14911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472057600 00000100:00100000:1.0:1788179253.441101:0:14911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472057600 00000100:00100000:1.0:1788179253.441250:0:14911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788179253.441260:0:14911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472057600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788179253.441299:0:14911:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788179253.441353:0:14911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472057600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179253.441361:0:14911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788179253.441422:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788179253.441601:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc90703b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472057600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788179253.459324:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179253.459386:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451090944 00000100:00100000:3.0:1788179253.459397:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451090944 00000100:00100000:3.0:1788179253.459460:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 81 00000100:00100000:3.0:1788179253.459471:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e79d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+8:13719:x1875041451090944:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788179253.460105:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e79d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+8:13719:x1875041451090944:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 633us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179253.460114:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 81 00000100:00100000:1.0:1788179253.472710:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179253.472794:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451091072 00000100:00100000:2.0:1788179253.472804:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451091072 00000100:00100000:2.0:1788179253.472879:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 82 00000100:00100000:2.0:1788179253.472890:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e79e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+8:13701:x1875041451091072:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788179253.472908:0:14269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179253.472927:0:14269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc920624a00/0xaa4c98508c499dc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x34c7c42474662383 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179253.472956:0:14269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc920624a00/0xaa4c98508c499dc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662383 expref: 9 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179253.472967:0:14269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc920624a00/0xaa4c98508c499dc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662383 expref: 9 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179253.472977:0:14269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc920624a00, rc 0) 00000100:00100000:2.0:1788179253.473045:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e79e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+9:13701:x1875041451091072:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 157us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179253.473052:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 82 00000100:00100000:1.0:1788179253.478167:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179253.478367:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451091200 00000100:00100000:3.0:1788179253.478377:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451091200 00000100:00100000:3.0:1788179253.478476:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 83 00000100:00100000:3.0:1788179253.478486:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e79d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+9:13701:x1875041451091200:12345-192.168.202.2@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788179253.478511:0:14268:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788179253.478534:0:14268:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788179253.478538:0:14268:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788179253.478541:0:14268:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788179253.478543:0:14268:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1788179253.486026:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e79d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+9:13701:x1875041451091200:12345-192.168.202.2@tcp:256:mount.lustre.0 Request processed in 7530us (7857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179253.486041:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 83 00000100:00100000:1.0:1788179253.489025:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179253.489197:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451091328 00000100:00100000:0.0:1788179253.489208:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451091328 00000100:00100000:0.0:1788179253.489267:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 84 00000100:00100000:0.0:1788179253.489277:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e79f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+9:13701:x1875041451091328:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788179253.489295:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179253.489314:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc91317ea00/0xaa4c98508c499dce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x34c7c4247466238a expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179253.489343:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc91317ea00/0xaa4c98508c499dce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466238a expref: 10 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179253.489353:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc91317ea00/0xaa4c98508c499dce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466238a expref: 10 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179253.489363:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317ea00, rc 0) 00000100:00100000:0.0:1788179253.489423:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e79f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+10:13701:x1875041451091328:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 147us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179253.489441:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 84 00000100:00100000:1.0:1788179253.491434:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179253.491721:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451091456 00000100:00100000:3.0:1788179253.491730:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451091456 00000100:00100000:3.0:1788179253.491792:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 85 00000100:00100000:3.0:1788179253.491802:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e79f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+10:13701:x1875041451091456:12345-192.168.202.2@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788179253.492133:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e79f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+10:13701:x1875041451091456:12345-192.168.202.2@tcp:501:mount.lustre.0 Request processed in 331us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179253.492148:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 85 00000100:00100000:1.0:1788179253.499402:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179253.500124:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451091584 00000100:00100000:2.0:1788179253.500136:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451091584 00000100:00100000:2.0:1788179253.500208:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 86 00000100:00100000:2.0:1788179253.500219:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e79c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+10:13701:x1875041451091584:12345-192.168.202.2@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788179253.500795:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e79c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+10:13701:x1875041451091584:12345-192.168.202.2@tcp:503:mount.lustre.0 Request processed in 575us (1400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179253.500816:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 86 00000100:00100000:1.0:1788179253.503983:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179253.508093:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451091712 00000100:00100000:0.0:1788179253.508120:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451091712 00000100:00100000:0.0:1788179253.508371:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 87 00000100:00100000:0.0:1788179253.508384:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e79c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+10:13725:x1875041451091712:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788179253.508891:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e79c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+10:13725:x1875041451091712:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 509us (4917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179253.508900:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 87 00000100:00100000:1.0:1788179253.517648:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179253.517785:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451091840 00000100:00100000:2.0:1788179253.517797:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451091840 00000100:00100000:2.0:1788179253.517894:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 88 00000100:00100000:2.0:1788179253.517906:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e79d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+10:13725:x1875041451091840:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788179253.518164:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e79d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+10:13725:x1875041451091840:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 259us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179253.518171:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 88 00000100:00100000:1.0:1788179253.527350:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179253.527441:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451091968 00000100:00100000:3.0:1788179253.527451:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451091968 00000100:00100000:3.0:1788179253.527513:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:3.0:1788179253.527521:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2353:x1875041451091968:12345-192.168.202.2@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788179253.527552:0:14274:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from baf94a59-5a83-4c54-8a75-155abe3189eb@192.168.202.2@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:3.0:1788179253.527610:0:14274:0:(genops.c:1407:class_connect()) connect: client baf94a59-5a83-4c54-8a75-155abe3189eb, cookie 0xaa4c98508c499dd5 00000004:00100000:3.0:1788179253.527641:0:14274:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788179253.527648:0:14274:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788179253.581149:0:14274:0:(import.c:65:import_set_state_nolock()) ffff9bc802750800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788179253.581241:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+6:2353:x1875041451091968:12345-192.168.202.2@tcp:38:mount.lustre.0 Request processed in 53717us (53899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179253.581253:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:1.0:1788179253.584425:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179253.584493:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179253.584626:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451092096 00000100:00100000:3.0:1788179253.584635:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451092096 00000100:00100000:3.0:1788179253.584745:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451092224 00000100:00100000:3.0:1788179253.584748:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451092224 00000100:00100000:3.0:1788179253.584762:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:3.0:1788179253.584771:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+7:0:x1875041451092096:12345-192.168.202.2@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788179253.584829:0:14275:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788179253.584930:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+7:0:x1875041451092096:12345-192.168.202.2@tcp:41:mount.lustre.0 Request processed in 160us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179253.584938:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:3.0:1788179253.584954:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:3.0:1788179253.584960:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+6:13701:x1875041451092224:12345-192.168.202.2@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788179253.584969:0:14275:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788179253.584988:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+6:13701:x1875041451092224:12345-192.168.202.2@tcp:41:mount.lustre.0 Request processed in 29us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179253.584994:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00080000:2.0:1788179253.585926:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788179253.587076:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179253.587244:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451092352 00000100:00100000:3.0:1788179253.587253:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451092352 00000100:00100000:3.0:1788179253.587334:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:3.0:1788179253.587344:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+6:13701:x1875041451092352:12345-192.168.202.2@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788179253.587428:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+6:13701:x1875041451092352:12345-192.168.202.2@tcp:40:mount.lustre.0 Request processed in 85us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179253.587436:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:1.0:1788179253.589507:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179253.589721:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451092736 00000100:00100000:0.0:1788179253.589731:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451092736 00000100:00100000:0.0:1788179253.589829:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:0.0:1788179253.589840:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+6:13701:x1875041451092736:12345-192.168.202.2@tcp:33:mount.lustre.0 00000100:00100000:1.0:1788179253.594915:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179253.594962:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179253.594994:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451092480 00000100:00100000:1.0:1788179253.595005:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451092480 00000100:00100000:1.0:1788179253.595041:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451092608 00000100:00100000:1.0:1788179253.595044:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451092608 00000100:00100000:1.0:1788179253.595059:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:1.0:1788179253.595068:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803601500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1875041451092480:12345-192.168.202.2@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788179253.595794:0:14910:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from baf94a59-5a83-4c54-8a75-155abe3189eb@192.168.202.2@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:1.0:1788179253.595841:0:14910:0:(genops.c:1407:class_connect()) connect: client baf94a59-5a83-4c54-8a75-155abe3189eb, cookie 0xaa4c98508c499ddc 00002000:00100000:1.0:1788179253.595884:0:14910:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli baf94a59-5a83-4c54-8a75-155abe3189eb/ffff9bc909288800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211371b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788179253.595896:0:14910:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788179253.596235:0:14910:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788179253.596269:0:14910:0:(import.c:65:import_set_state_nolock()) ffff9bc90928e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788179253.596342:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803601500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+6:2353:x1875041451092480:12345-192.168.202.2@tcp:8:mount.lustre.0 Request processed in 1274us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179253.596351:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:1.0:1788179253.596376:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:1.0:1788179253.596381:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803603b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1875041451092608:12345-192.168.202.2@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788179253.596399:0:14910:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from baf94a59-5a83-4c54-8a75-155abe3189eb@192.168.202.2@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:1.0:1788179253.596418:0:14910:0:(genops.c:1407:class_connect()) connect: client baf94a59-5a83-4c54-8a75-155abe3189eb, cookie 0xaa4c98508c499de3 00002000:00100000:1.0:1788179253.596423:0:14910:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli baf94a59-5a83-4c54-8a75-155abe3189eb/ffff9bc90928f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211371b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788179253.596438:0:14910:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788179253.596534:0:14910:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788179253.596548:0:14910:0:(import.c:65:import_set_state_nolock()) ffff9bc90928c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788179253.599216:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803603b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+6:2353:x1875041451092608:12345-192.168.202.2@tcp:8:mount.lustre.0 Request processed in 2821us (4240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179253.599233:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000004:00080000:2.0:1788179253.600861:0:14277:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 10917us 00000004:00200000:0.0:1788179253.614063:0:14277:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1788179253.614393:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+6:13701:x1875041451092736:12345-192.168.202.2@tcp:33:mount.lustre.0 Request processed in 24548us (24887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179253.614406:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:3.0:1788179253.760053:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179253.760128:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451092864 00000100:00100000:0.0:1788179253.760138:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451092864 00000100:00100000:0.0:1788179253.760202:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:0.0:1788179253.760212:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+6:13746:x1875041451092864:12345-192.168.202.2@tcp:101:mkdir.0 00010000:00010000:0.0:1788179253.760232:0:14276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179253.760271:0:14276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499dea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746623b4 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179253.760332:0:14276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e800/0xaa4c98508c499df1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179253.760344:0:14276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e800/0xaa4c98508c499df1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179253.760357:0:14276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e800/0xaa4c98508c499df1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179253.760535:0:14276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788179253.760539:0:14276:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1788179253.760642:0:14276:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e800/0xaa4c98508c499df1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179253.760668:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499dea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746623b4 expref: 8 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179253.760686:0:14276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e800/0xaa4c98508c499df1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746623b4 expref: 7 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179253.760695:0:14276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc9062cb300) 00010000:00010000:0.0:1788179253.760698:0:14276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788179253.760701:0:14276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317e800, rc 0) 00000100:00100000:0.0:1788179253.760788:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+7:13746:x1875041451092864:12345-192.168.202.2@tcp:101:mkdir.0 Request processed in 576us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179253.760795:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00010000:00010000:2.0:1788179253.952039:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179254.986059:0:15878:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179255.490745:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce136049-9565-40c1-979f-49dcc63d6657:3308:1875041472057728:0@lo:400:kworker.0 00000100:00100000:1.0:1788179255.490826:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179255.490913:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875041472058240:0@lo:400:kworker.0 00000100:00100000:1.0:1788179255.491050:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179255.491075:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788179255.491081:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875041472058112:0@lo:400:kworker.0 00000100:00100000:1.0:1788179255.491101:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179255.491124:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472057856:0@lo:400:kworker.0 00000100:00100000:1.0:1788179255.491150:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179255.491167:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875041472058368:0@lo:400:kworker.0 00000100:00100000:1.0:1788179255.491190:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179255.491203:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788179255.491208:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc803602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472057984:0@lo:400:kworker.0 00000100:00100000:1.0:1788179255.491226:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179255.491256:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472058240 00000100:00100000:1.0:1788179255.491262:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472058240 00000100:00100000:1.0:1788179255.491308:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472058112 00000100:00100000:1.0:1788179255.491311:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472058112 00000100:00100000:1.0:1788179255.491322:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472058368 00000100:00100000:1.0:1788179255.491324:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472058368 00000100:00100000:1.0:1788179255.491338:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788179255.491345:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875041472058240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179255.491394:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875041472058240:12345-0@lo:400:kworker.0 Request processed in 48us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179255.491400:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788179255.491416:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788179255.491421:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875041472058112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179255.491446:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875041472058112:12345-0@lo:400:kworker.0 Request processed in 25us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179255.491460:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788179255.491472:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788179255.491478:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875041472058368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179255.491510:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875041472058368:12345-0@lo:400:kworker.0 Request processed in 32us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179255.491516:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788179255.492064:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472057856 00000100:00100000:1.0:1788179255.492069:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472057856 00000100:00100000:1.0:1788179255.492099:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472057984 00000100:00100000:1.0:1788179255.492102:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472057984 00000100:00100000:1.0:1788179255.492120:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788179255.492126:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472057856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179255.492166:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472057856:12345-0@lo:400:kworker.0 Request processed in 39us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179255.492173:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788179255.492184:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788179255.492190:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1875041472057984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179255.492218:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1875041472057984:12345-0@lo:400:kworker.0 Request processed in 29us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179255.492224:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788179255.492265:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875041472058112:0@lo:400:kworker.0 00000100:00100000:1.0:1788179255.492281:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875041472058240:0@lo:400:kworker.0 00000100:00100000:1.0:1788179255.492330:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472057984:0@lo:400:kworker.0 00000100:00100000:1.0:1788179255.492340:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472057856:0@lo:400:kworker.0 00000100:00100000:1.0:1788179255.492361:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875041472058368:0@lo:400:kworker.0 00000100:00080000:1.0:1788179255.492387:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788179255.492391:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788179255.492394:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788179255.492428:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472057728 00000100:00100000:1.0:1788179255.492432:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472057728 00000100:00100000:1.0:1788179255.492457:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788179255.492464:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e79c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+19:3308:x1875041472057728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179255.492501:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e79c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+19:3308:x1875041472057728:12345-0@lo:400:kworker.0 Request processed in 37us (1675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179255.492507:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788179255.493912:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc803603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce136049-9565-40c1-979f-49dcc63d6657:3308:1875041472057728:0@lo:400:kworker.0 00000100:00100000:1.0:1788179255.495843:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc907038e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472058496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788179255.496683:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179255.500139:0:14911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472058496 00000100:00100000:0.0:1788179255.500170:0:14911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472058496 00000100:00100000:0.0:1788179255.500228:0:14911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788179255.500237:0:14911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875041472058496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788179255.500273:0:14911:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788179255.500354:0:14911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875041472058496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (3671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179255.500361:0:14911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788179255.500435:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc907038e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472058496:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1788179255.614647:0:7496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of baf94a59-5a83-4c54-8a75-155abe3189eb 00000001:00080000:2.0:1788179255.614679:0:7496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1788179255.614754:0:7496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788179255.730142:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179255.730278:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451092992 00000100:00100000:2.0:1788179255.730290:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451092992 00000100:00100000:2.0:1788179255.730365:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:2.0:1788179255.730375:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+7:13798:x1875041451092992:12345-192.168.202.2@tcp:41:lfs.0 00000004:00000024:2.0:1788179255.730417:0:14274:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788179255.730525:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+7:13798:x1875041451092992:12345-192.168.202.2@tcp:41:lfs.0 Request processed in 151us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179255.730533:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00080000:1.0:1788179255.731236:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788179255.734267:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179255.734382:0:14911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451093120 00000100:00100000:0.0:1788179255.734392:0:14911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451093120 00000100:00100000:0.0:1788179255.734793:0:14911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:0.0:1788179255.734804:0:14911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:baf94a59-5a83-4c54-8a75-155abe3189eb+6:13798:x1875041451093120:12345-192.168.202.2@tcp:13:lfs.0 00002000:00000024:0.0:1788179255.734843:0:14911:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788179255.734982:0:14911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:baf94a59-5a83-4c54-8a75-155abe3189eb+6:13798:x1875041451093120:12345-192.168.202.2@tcp:13:lfs.0 Request processed in 180us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179255.734992:0:14911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:3.0:1788179255.737487:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179255.737701:0:14911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451093248 00000100:00100000:0.0:1788179255.737712:0:14911:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451093248 00000100:00080000:1.0:1788179255.737839:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788179255.737844:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788179255.739250:0:14911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:0.0:1788179255.739266:0:14911:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:baf94a59-5a83-4c54-8a75-155abe3189eb+5:13798:x1875041451093248:12345-192.168.202.2@tcp:13:lfs.0 00002000:00000024:0.0:1788179255.739293:0:14911:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788179255.739391:0:14911:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:baf94a59-5a83-4c54-8a75-155abe3189eb+5:13798:x1875041451093248:12345-192.168.202.2@tcp:13:lfs.0 Request processed in 129us (1913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179255.739399:0:14911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:3.0:1788179255.942982:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179255.943079:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451093376 00000100:00100000:2.0:1788179255.943089:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451093376 00000100:00100000:2.0:1788179255.943164:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 90 00000100:00100000:2.0:1788179255.943175:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e79e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+10:13829:x1875041451093376:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788179255.943192:0:14268:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179255.943211:0:14268:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc920625800/0xaa4c98508c499df8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x34c7c424746623bb expref: -99 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179255.943238:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc920625800/0xaa4c98508c499df8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746623bb expref: 11 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179255.943248:0:14268:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc920625800/0xaa4c98508c499df8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746623bb expref: 11 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179255.943256:0:14268:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc920625800, rc 0) 00000100:00100000:2.0:1788179255.943316:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e79e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+11:13829:x1875041451093376:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 143us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179255.943324:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 90 00000100:00100000:1.0:1788179255.950611:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179255.950716:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451093504 00000100:00100000:2.0:1788179255.950725:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451093504 00000100:00100000:2.0:1788179255.950792:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 91 00000100:00100000:2.0:1788179255.950802:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92677f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+11:13829:x1875041451093504:12345-192.168.202.2@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788179255.951157:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92677f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+11:13829:x1875041451093504:12345-192.168.202.2@tcp:501:mount.lustre.0 Request processed in 356us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179255.951166:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 91 00000100:00100000:3.0:1788179255.959028:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179255.959129:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451093632 00000100:00100000:1.0:1788179255.959140:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451093632 00000100:00100000:1.0:1788179255.959202:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 92 00000100:00100000:1.0:1788179255.959212:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92677f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+11:13829:x1875041451093632:12345-192.168.202.2@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788179255.959482:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92677f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+11:13829:x1875041451093632:12345-192.168.202.2@tcp:503:mount.lustre.0 Request processed in 270us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179255.959490:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 92 00000100:00100000:1.0:1788179255.990585:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179255.990676:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451093760 00000100:00100000:3.0:1788179255.990687:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451093760 00000100:00100000:3.0:1788179255.990745:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 93 00000100:00100000:3.0:1788179255.990791:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92677ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+11:13837:x1875041451093760:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788179255.991099:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92677ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+11:13837:x1875041451093760:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 344us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179255.991108:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 93 00010000:00010000:2.0:1788179256.001117:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179256.018421:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179256.018551:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451093888 00000100:00100000:2.0:1788179256.018561:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451093888 00000100:00100000:2.0:1788179256.018622:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 94 00000100:00100000:2.0:1788179256.018632:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92677e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+11:13837:x1875041451093888:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788179256.019020:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92677e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+11:13837:x1875041451093888:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 388us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179256.019029:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 94 00000100:00100000:2.0:1788179256.036401:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179256.039635:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451094016 00000100:00100000:1.0:1788179256.039650:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451094016 00000100:00100000:1.0:1788179256.039844:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 95 00000100:00100000:1.0:1788179256.039867:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92677e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+11:13829:x1875041451094016:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788179256.039892:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179256.039912:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc92f7ce400/0xaa4c98508c499dff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x34c7c424746623e5 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179256.039940:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc92f7ce400/0xaa4c98508c499dff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746623e5 expref: 12 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179256.039952:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc92f7ce400/0xaa4c98508c499dff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746623e5 expref: 12 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179256.039961:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc92f7ce400, rc 0) 00000100:00100000:1.0:1788179256.040037:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92677e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+12:13829:x1875041451094016:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 171us (3647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179256.040042:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 95 00000100:00100000:3.0:1788179256.042958:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179256.042994:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451094144 00000100:00100000:3.0:1788179256.043003:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451094144 00000100:00100000:3.0:1788179256.043043:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 96 00000100:00100000:3.0:1788179256.043052:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92677d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+12:13829:x1875041451094144:12345-192.168.202.2@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788179256.043075:0:14268:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788179256.043097:0:14268:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788179256.043105:0:14268:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788179256.043108:0:14268:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788179256.043110:0:14268:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1788179256.044486:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92677d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+12:13829:x1875041451094144:12345-192.168.202.2@tcp:256:mount.lustre.0 Request processed in 1429us (1531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179256.044498:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 96 00000100:00100000:3.0:1788179256.046949:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179256.047068:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451094272 00000100:00100000:0.0:1788179256.047078:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451094272 00000100:00100000:0.0:1788179256.047182:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 97 00000100:00100000:0.0:1788179256.047193:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92677cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+12:13829:x1875041451094272:12345-192.168.202.2@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788179256.047209:0:14268:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179256.047227:0:14268:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc91317f800/0xaa4c98508c499e06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x34c7c424746623ec expref: -99 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179256.047250:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc91317f800/0xaa4c98508c499e06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746623ec expref: 13 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179256.047257:0:14268:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc91317f800/0xaa4c98508c499e06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746623ec expref: 13 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179256.047264:0:14268:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317f800, rc 0) 00000100:00100000:0.0:1788179256.047306:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92677cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+13:13829:x1875041451094272:12345-192.168.202.2@tcp:101:mount.lustre.0 Request processed in 116us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179256.047314:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 97 00000100:00100000:3.0:1788179256.048625:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179256.048690:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451094400 00000100:00100000:1.0:1788179256.048698:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451094400 00000100:00100000:1.0:1788179256.048737:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 98 00000100:00100000:1.0:1788179256.048745:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92677e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+13:13829:x1875041451094400:12345-192.168.202.2@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788179256.049037:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92677e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+13:13829:x1875041451094400:12345-192.168.202.2@tcp:501:mount.lustre.0 Request processed in 291us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179256.049045:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 98 00000100:00100000:3.0:1788179256.050299:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179256.050556:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451094528 00000100:00100000:2.0:1788179256.050563:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451094528 00000100:00100000:2.0:1788179256.050599:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 99 00000100:00100000:2.0:1788179256.050605:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92677dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+13:13829:x1875041451094528:12345-192.168.202.2@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788179256.050803:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92677dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+13:13829:x1875041451094528:12345-192.168.202.2@tcp:503:mount.lustre.0 Request processed in 193us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179256.050812:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 99 00000100:00100000:3.0:1788179256.052801:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179256.052906:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451094656 00000100:00100000:1.0:1788179256.052927:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451094656 00000100:00100000:1.0:1788179256.052981:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 100 00000100:00100000:1.0:1788179256.052990:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92677c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+13:13841:x1875041451094656:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788179256.053211:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92677c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+13:13841:x1875041451094656:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 220us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179256.053219:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 100 00000100:00100000:0.0:1788179256.058620:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179256.058797:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451094784 00000100:00100000:3.0:1788179256.058809:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451094784 00000100:00100000:1.0:1788179256.059192:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 101 00000100:00100000:1.0:1788179256.059204:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92677f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+13:13841:x1875041451094784:12345-192.168.202.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788179256.059486:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92677f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+13:13841:x1875041451094784:12345-192.168.202.2@tcp:502:llog_process_th.0 Request processed in 283us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179256.059495:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 101 00000100:00100000:0.0:1788179256.068369:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179256.068407:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179256.068648:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451094912 00000100:00100000:2.0:1788179256.068765:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451095296 00000100:00100000:2.0:1788179256.068772:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451095296 00000100:00100000:2.0:1788179256.068839:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:2.0:1788179256.068892:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+7:2355:x1875041451095296:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179256.069068:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179256.069261:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451094912 00000100:00100000:1.0:1788179256.069289:0:14274:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788179256.069297:0:14274:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788179256.069316:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451095552 00000100:00100000:1.0:1788179256.069319:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451095552 00000100:00100000:1.0:1788179256.069345:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:1.0:1788179256.069353:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+5:2355:x1875041451095552:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179256.069385:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+5:2355:x1875041451095552:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 33us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179256.069392:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:0.0:1788179256.069866:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179256.069916:0:14908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451095424 00000100:00100000:0.0:1788179256.069920:0:14908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451095424 00000100:00100000:0.0:1788179256.069946:0:14908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:0.0:1788179256.069953:0:14908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+6:2355:x1875041451095424:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179256.069997:0:14908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+6:2355:x1875041451095424:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 45us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179256.070016:0:14908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:1.0:1788179256.070621:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:1.0:1788179256.070629:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2353:x1875041451094912:12345-192.168.202.2@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788179256.070653:0:14274:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 173e045c-d692-4828-8fa4-7aaba778738a@192.168.202.2@tcp t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:1.0:1788179256.070701:0:14274:0:(genops.c:1407:class_connect()) connect: client 173e045c-d692-4828-8fa4-7aaba778738a, cookie 0xaa4c98508c499e0d 00000004:00100000:1.0:1788179256.070735:0:14274:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788179256.070894:0:14274:0:(import.c:65:import_set_state_nolock()) ffff9bc9070e4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788179256.070936:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173e045c-d692-4828-8fa4-7aaba778738a+6:2353:x1875041451094912:12345-192.168.202.2@tcp:38:mount.lustre.0 Request processed in 307us (2579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179256.070944:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:2.0:1788179256.071124:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+7:2355:x1875041451095296:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 126us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179256.071135:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:0.0:1788179256.080988:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179256.081095:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451095040 00000100:00100000:1.0:1788179256.081108:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451095040 00000100:00100000:1.0:1788179256.081238:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:1.0:1788179256.081249:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173e045c-d692-4828-8fa4-7aaba778738a+6:0:x1875041451095040:12345-192.168.202.2@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788179256.081292:0:14274:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788179256.081380:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173e045c-d692-4828-8fa4-7aaba778738a+6:0:x1875041451095040:12345-192.168.202.2@tcp:41:mount.lustre.0 Request processed in 132us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179256.081387:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00080000:3.0:1788179256.082816:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788179256.082952:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179256.083048:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451095168 00000100:00100000:2.0:1788179256.083058:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451095168 00000100:00100000:2.0:1788179256.083189:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:2.0:1788179256.083201:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173e045c-d692-4828-8fa4-7aaba778738a+6:13829:x1875041451095168:12345-192.168.202.2@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788179256.083232:0:14275:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788179256.083327:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173e045c-d692-4828-8fa4-7aaba778738a+6:13829:x1875041451095168:12345-192.168.202.2@tcp:41:mount.lustre.0 Request processed in 129us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179256.083354:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:0.0:1788179256.085615:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179256.085706:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451095680 00000100:00100000:1.0:1788179256.085717:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451095680 00000100:00100000:1.0:1788179256.085787:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:1.0:1788179256.085797:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173e045c-d692-4828-8fa4-7aaba778738a+6:13829:x1875041451095680:12345-192.168.202.2@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788179256.085898:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173e045c-d692-4828-8fa4-7aaba778738a+6:13829:x1875041451095680:12345-192.168.202.2@tcp:40:mount.lustre.0 Request processed in 102us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179256.085906:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:0.0:1788179256.087697:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179256.087787:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179256.087815:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179256.087959:0:14908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451095808 00000100:00100000:1.0:1788179256.087970:0:14908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451095808 00000100:00100000:1.0:1788179256.088046:0:14908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451095936 00000100:00100000:1.0:1788179256.088050:0:14908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451095936 00000100:00100000:0.0:1788179256.088199:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:0.0:1788179256.088206:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1875041451095808:12345-192.168.202.2@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788179256.088238:0:14910:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 173e045c-d692-4828-8fa4-7aaba778738a@192.168.202.2@tcp t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:0.0:1788179256.088272:0:14910:0:(genops.c:1407:class_connect()) connect: client 173e045c-d692-4828-8fa4-7aaba778738a, cookie 0xaa4c98508c499e14 00002000:00100000:0.0:1788179256.088283:0:14910:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 173e045c-d692-4828-8fa4-7aaba778738a/ffff9bc802753000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211371b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788179256.088292:0:14910:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788179256.088387:0:14910:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788179256.088411:0:14910:0:(import.c:65:import_set_state_nolock()) ffff9bc802757000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788179256.089096:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173e045c-d692-4828-8fa4-7aaba778738a+6:2353:x1875041451095808:12345-192.168.202.2@tcp:8:mount.lustre.0 Request processed in 886us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179256.089105:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:0.0:1788179256.089129:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:0.0:1788179256.089134:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1875041451095936:12345-192.168.202.2@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788179256.089154:0:14910:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 173e045c-d692-4828-8fa4-7aaba778738a@192.168.202.2@tcp t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:0.0:1788179256.089183:0:14910:0:(genops.c:1407:class_connect()) connect: client 173e045c-d692-4828-8fa4-7aaba778738a, cookie 0xaa4c98508c499e1b 00002000:00100000:0.0:1788179256.089190:0:14910:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 173e045c-d692-4828-8fa4-7aaba778738a/ffff9bc802754800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211371b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788179256.089217:0:14910:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788179256.089412:0:14910:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788179256.089443:0:14910:0:(import.c:65:import_set_state_nolock()) ffff9bc802756800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788179256.089476:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173e045c-d692-4828-8fa4-7aaba778738a+6:2353:x1875041451095936:12345-192.168.202.2@tcp:8:mount.lustre.0 Request processed in 340us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179256.089483:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:0.0:1788179256.089515:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451096064 00000100:00100000:0.0:1788179256.089522:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451096064 00000100:00100000:0.0:1788179256.089561:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:0.0:1788179256.089568:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173e045c-d692-4828-8fa4-7aaba778738a+6:13829:x1875041451096064:12345-192.168.202.2@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788179256.089730:0:14278:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1788179256.089836:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173e045c-d692-4828-8fa4-7aaba778738a+6:13829:x1875041451096064:12345-192.168.202.2@tcp:33:mount.lustre.0 Request processed in 269us (2148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179256.089841:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:0.0:1788179256.251972:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179256.252200:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451096192 00000100:00100000:3.0:1788179256.252210:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451096192 00000100:00100000:3.0:1788179256.252317:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:3.0:1788179256.252328:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173e045c-d692-4828-8fa4-7aaba778738a+6:13862:x1875041451096192:12345-192.168.202.2@tcp:101:mkdir.0 00010000:00010000:3.0:1788179256.252348:0:14276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179256.252373:0:14276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499e22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662416 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179256.252440:0:14276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499e29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179256.252454:0:14276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499e29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179256.252464:0:14276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499e29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788179256.252760:0:14276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788179256.252765:0:14276:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1788179256.252871:0:14276:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499e29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179256.252900:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c499e22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662416 expref: 8 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179256.252916:0:14276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499e29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662416 expref: 7 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179256.252925:0:14276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc9062cb300) 00010000:00010000:3.0:1788179256.252928:0:14276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788179256.252932:0:14276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b5200, rc 0) 00000100:00100000:3.0:1788179256.253036:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173e045c-d692-4828-8fa4-7aaba778738a+7:13862:x1875041451096192:12345-192.168.202.2@tcp:101:mkdir.0 Request processed in 710us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179256.253044:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00000001:00100000:2.0:1788179256.605248:0:6618:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 173e045c-d692-4828-8fa4-7aaba778738a 00000001:00100000:2.0:1788179256.605267:0:6618:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of baf94a59-5a83-4c54-8a75-155abe3189eb 00010000:00010000:2.0:1788179257.026987:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179258.057149:0:15878:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179258.561192:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc90703b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472058624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788179258.561280:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179258.561406:0:14912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472058624 00000100:00100000:2.0:1788179258.561415:0:14912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472058624 00000100:00100000:2.0:1788179258.561520:0:14912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788179258.561530:0:14912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472058624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788179258.561567:0:14912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179258.561619:0:14912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875041472058624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179258.561627:0:14912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788179258.561713:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc90703b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1875041472058624:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788179258.564477:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1788179258.631599:0:5818:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of baf94a59-5a83-4c54-8a75-155abe3189eb 00000001:00100000:2.0:1788179258.631623:0:5818:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 173e045c-d692-4828-8fa4-7aaba778738a 00000001:02000400:1.0:1788179258.807481:0:16141:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788179259.072270:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788179259.590161:0:14308:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788179260.096006:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179260.618099:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce136049-9565-40c1-979f-49dcc63d6657:3308:1875041472058752:0@lo:400:kworker.0 00000100:00100000:1.0:1788179260.618184:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179260.618234:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875041472059264:0@lo:400:kworker.0 00000100:00100000:1.0:1788179260.618261:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179260.618287:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788179260.618293:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875041472059136:0@lo:400:kworker.0 00000100:00100000:1.0:1788179260.618313:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179260.618346:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472058880:0@lo:400:kworker.0 00000100:00100000:1.0:1788179260.618371:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179260.618389:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875041472059392:0@lo:400:kworker.0 00000100:00100000:1.0:1788179260.618410:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179260.618428:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788179260.618433:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472059008:0@lo:400:kworker.0 00000100:00100000:1.0:1788179260.618454:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179260.618489:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472058752 00000100:00100000:1.0:1788179260.618497:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472058752 00000100:00100000:1.0:1788179260.618546:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788179260.618555:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92677c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+19:3308:x1875041472058752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179260.618608:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92677c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+19:3308:x1875041472058752:12345-0@lo:400:kworker.0 Request processed in 54us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179260.618616:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788179260.619100:0:16052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472059264 00000100:00100000:2.0:1788179260.619107:0:16052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472059264 00000100:00100000:2.0:1788179260.619159:0:16052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472059136 00000100:00100000:2.0:1788179260.619162:0:16052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472059136 00000100:00100000:2.0:1788179260.619174:0:16052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472059392 00000100:00100000:2.0:1788179260.619177:0:16052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472059392 00000100:00100000:2.0:1788179260.619190:0:16052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788179260.619197:0:16052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875041472059264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179260.619244:0:16052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875041472059264:12345-0@lo:400:kworker.0 Request processed in 47us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179260.619260:0:16052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788179260.619280:0:16052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788179260.619285:0:16052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875041472059136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179260.619317:0:16052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875041472059136:12345-0@lo:400:kworker.0 Request processed in 31us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179260.619323:0:16052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788179260.619334:0:16052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788179260.619340:0:16052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875041472059392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179260.619374:0:16052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875041472059392:12345-0@lo:400:kworker.0 Request processed in 35us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179260.619379:0:16052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788179260.619397:0:14907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472058880 00000100:00100000:2.0:1788179260.619400:0:14907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472058880 00000100:00100000:2.0:1788179260.619421:0:14907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472059008 00000100:00100000:2.0:1788179260.619423:0:14907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472059008 00000100:00100000:2.0:1788179260.619438:0:14907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788179260.619443:0:14907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472058880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179260.619474:0:14907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472058880:12345-0@lo:400:kworker.0 Request processed in 30us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179260.619479:0:14907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788179260.619488:0:14907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788179260.619494:0:14907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472059008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179260.619520:0:14907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472059008:12345-0@lo:400:kworker.0 Request processed in 26us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179260.619525:0:14907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788179260.620835:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc90703b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472059520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788179260.620896:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179260.620950:0:14912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472059520 00000100:00100000:1.0:1788179260.620957:0:14912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472059520 00000100:00100000:1.0:1788179260.620999:0:14912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788179260.621006:0:14912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472059520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788179260.621039:0:14912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788179260.621081:0:14912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472059520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179260.621088:0:14912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788179260.621125:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788179260.621153:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc90703b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472059520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788179260.621182:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472059008:0@lo:400:kworker.0 00000100:00100000:1.0:1788179260.621195:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472058880:0@lo:400:kworker.0 00000100:00100000:1.0:1788179260.621206:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1875041472059392:0@lo:400:kworker.0 00000100:00080000:0.0:1788179260.624346:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788179260.624357:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788179260.624362:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788179260.627198:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875041472059136:0@lo:400:kworker.0 00000100:00100000:1.0:1788179260.627230:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce136049-9565-40c1-979f-49dcc63d6657:3308:1875041472058752:0@lo:400:kworker.0 00000100:00100000:1.0:1788179260.627244:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1875041472059264:0@lo:400:kworker.0 00000001:00100000:1.0:1788179260.701814:0:7496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 173e045c-d692-4828-8fa4-7aaba778738a 00010000:00010000:1.0:1788179261.123984:0:15878:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179261.576386:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179261.576431:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179261.576477:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179261.576510:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179261.576532:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179261.576554:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179261.576599:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179261.576751:0:14908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451096704 00000100:00100000:0.0:1788179261.576763:0:14908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451096704 00000100:00100000:0.0:1788179261.576822:0:14908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451096960 00000100:00100000:0.0:1788179261.576826:0:14908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451096960 00000100:00100000:0.0:1788179261.576842:0:14908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451096576 00000100:00100000:0.0:1788179261.576844:0:14908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451096576 00000100:00100000:0.0:1788179261.576970:0:14908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451097088 00000100:00100000:0.0:1788179261.576973:0:14908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451097088 00000100:00100000:0.0:1788179261.576996:0:14908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:0.0:1788179261.577006:0:14908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+5:2355:x1875041451096704:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179261.577154:0:14908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+5:2355:x1875041451096704:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 149us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179261.577163:0:14908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:0.0:1788179261.577184:0:14908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:0.0:1788179261.577191:0:14908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173e045c-d692-4828-8fa4-7aaba778738a+5:2355:x1875041451096960:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179261.577216:0:14908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173e045c-d692-4828-8fa4-7aaba778738a+5:2355:x1875041451096960:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 26us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179261.577222:0:14908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:0.0:1788179261.577237:0:14908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:0.0:1788179261.577243:0:14908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+5:2355:x1875041451096576:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179261.577266:0:14908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+5:2355:x1875041451096576:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 23us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179261.577273:0:14908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:0.0:1788179261.577286:0:14908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:0.0:1788179261.577293:0:14908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173e045c-d692-4828-8fa4-7aaba778738a+5:2355:x1875041451097088:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179261.577326:0:14908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173e045c-d692-4828-8fa4-7aaba778738a+5:2355:x1875041451097088:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 34us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179261.577333:0:14908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:0.0:1788179261.577354:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451096320 00000100:00100000:0.0:1788179261.577358:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451096320 00000100:00100000:0.0:1788179261.577386:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 103 00000100:00100000:0.0:1788179261.577393:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92677d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+13:2355:x1875041451096320:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179261.577419:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92677d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+13:2355:x1875041451096320:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 26us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179261.577426:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 103 00000100:00100000:0.0:1788179261.577457:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451096448 00000100:00100000:2.0:1788179261.577591:0:16052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451096832 00000100:00100000:2.0:1788179261.577597:0:16052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451096832 00000100:00100000:2.0:1788179261.577652:0:16052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:2.0:1788179261.577659:0:16052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173e045c-d692-4828-8fa4-7aaba778738a+6:2355:x1875041451096832:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:2.0:1788179261.577689:0:16052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173e045c-d692-4828-8fa4-7aaba778738a+6:2355:x1875041451096832:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 31us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179261.577695:0:16052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00080000:2.0:1788179261.578510:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788179261.578517:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788179261.578519:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788179261.578561:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451096448 00000100:00100000:0.0:1788179261.578633:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:0.0:1788179261.578641:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+6:2355:x1875041451096448:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179261.578693:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+6:2355:x1875041451096448:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 53us (2317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179261.578712:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00080000:2.0:1788179261.581870:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:1.0:1788179262.086731:0:16290:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd70460330 20000000:00000080:1.0:1788179262.086751:0:16290:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9bc93b3c0000 uarg=0000000000000000 20000000:01000000:1.0:1788179262.086792:0:16290:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788179262.086798:0:16290:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788179262.086803:0:16290:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788179262.088322:0:16291:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1788179262.088437:0:16290:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788179262.094277:0:16290:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788179262.094322:0:16290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9bc92f7ce600/0xaa4c98508c499e30 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179262.094344:0:16290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc9136c5c00/0xaa4c98508c499b27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c499b20 expref: 18 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179262.094352:0:16290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc91317ee00/0xaa4c98508c499b74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c499b6d expref: 18 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179262.094360:0:16290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc9137b5800/0xaa4c98508c499ca8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c499ca1 expref: 18 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179262.094369:0:16290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc91317ea00/0xaa4c98508c499dce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466238a expref: 12 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179262.094375:0:16290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9bc91317f800/0xaa4c98508c499e06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746623ec expref: 12 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179262.094383:0:16290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9bc92f7ce600/0xaa4c98508c499e30 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179262.094428:0:16290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc91317f800/0xaa4c98508c499e06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746623ec expref: 12 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179262.094445:0:16290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bc91317f800/0xaa4c98508c499e06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746623ec expref: 12 pid: 14268 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179262.094460:0:16290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0f4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16290:1875041472059648:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788179262.094716:0:16290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc91317ea00/0xaa4c98508c499dce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466238a expref: 12 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179262.094737:0:16290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bc91317ea00/0xaa4c98508c499dce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466238a expref: 12 pid: 14266 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179262.094746:0:16290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0f4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16290:1875041472059776:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788179262.094784:0:16290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc9137b5800/0xaa4c98508c499ca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c499ca1 expref: 18 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179262.094793:0:16290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bc9137b5800/0xaa4c98508c499ca8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c499ca1 expref: 18 pid: 14269 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179262.094801:0:16290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0f6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16290:1875041472059904:0@lo:104: 00000100:00100000:1.0:1788179262.094844:0:16290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788179262.095053:0:16290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc91317ee00/0xaa4c98508c499b74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c499b6d expref: 18 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179262.095063:0:16290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bc91317ee00/0xaa4c98508c499b74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c499b6d expref: 18 pid: 14268 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179262.095071:0:16290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0f5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16290:1875041472060032:0@lo:104: 00000100:00100000:1.0:1788179262.095093:0:16290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788179262.101447:0:16290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9bc9136c5c00/0xaa4c98508c499b27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xaa4c98508c499b20 expref: 18 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179262.101465:0:16290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9bc9136c5c00/0xaa4c98508c499b27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xaa4c98508c499b20 expref: 18 pid: 14268 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179262.101481:0:16290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc935a22d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16290:1875041472060160:0@lo:104: 00000100:00100000:1.0:1788179262.101543:0:16290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179262.101624:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472059904 00000100:00100000:3.0:1788179262.101632:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472059904 00000100:00100000:3.0:1788179262.101666:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472060032 00000100:00100000:3.0:1788179262.101668:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472060032 00000100:00100000:3.0:1788179262.101678:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788179262.101684:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce136049-9565-40c1-979f-49dcc63d6657+4:16290:x1875041472059904:12345-0@lo:104: 00010000:00010000:3.0:1788179262.101706:0:14257:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5400/0xaa4c98508c499ca1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c499ca8 expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179262.101759:0:14257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788179262.101765:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce136049-9565-40c1-979f-49dcc63d6657+4:16290:x1875041472059904:12345-0@lo:104: Request processed in 81us (6922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179262.101775:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788179262.101789:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788179262.101793:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce136049-9565-40c1-979f-49dcc63d6657+3:16290:x1875041472060032:12345-0@lo:104: 00010000:00010000:3.0:1788179262.101799:0:14257:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499b6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c499b74 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179262.101829:0:14257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788179262.101834:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce136049-9565-40c1-979f-49dcc63d6657+3:16290:x1875041472060032:12345-0@lo:104: Request processed in 41us (6741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179262.101840:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788179262.101872:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788179262.101878:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5400/0xaa4c98508c499ca1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c499ca8 expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179262.102035:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179262.102094:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179262.102112:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451097216 00000100:00100000:0.0:1788179262.102116:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451097216 00010000:00010000:0.0:1788179262.102138:0:14258:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc91317f800/0xaa4c98508c499e06 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746623ec expref: 13 pid: 14268 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179262.102156:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451097344 00000100:00100000:0.0:1788179262.102159:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451097344 00010000:00010000:0.0:1788179262.102180:0:14258:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc91317ea00/0xaa4c98508c499dce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466238a expref: 14 pid: 14266 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179262.102192:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:0.0:1788179262.102196:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+14:2357:x1875041451097216:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179262.102203:0:14258:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179262.102207:0:14258:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc91317f800/0xaa4c98508c499e06 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746623ec expref: 14 pid: 14268 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179262.102214:0:14258:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc91317f800/0xaa4c98508c499e06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746623ec expref: 14 pid: 14268 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179262.102231:0:14258:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179262.102260:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+14:2357:x1875041451097216:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 64us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179262.102264:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:0.0:1788179262.102276:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:0.0:1788179262.102280:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+13:2357:x1875041451097344:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179262.102285:0:14258:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179262.102287:0:14258:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc91317ea00/0xaa4c98508c499dce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466238a expref: 13 pid: 14266 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179262.102295:0:14258:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc91317ea00/0xaa4c98508c499dce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466238a expref: 13 pid: 14266 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179262.102304:0:14258:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179262.102320:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+13:2357:x1875041451097344:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 38us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179262.102335:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 5 00010000:00010000:3.0:1788179262.103130:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5400 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:3.0:1788179262.103136:0:14261:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5400/0xaa4c98508c499ca1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c499ca8 expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179262.103145:0:14261:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5400/0xaa4c98508c499ca1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c499ca8 expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788179262.103153:0:14261:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5400/0xaa4c98508c499ca1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c499ca8 expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788179262.103159:0:14261:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788179262.103204:0:14261:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5400/0xaa4c98508c499ca1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c499ca8 expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179262.103209:0:14261:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788179262.103235:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5400/0xaa4c98508c499ca1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c499ca8 expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179262.103239:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5400/0xaa4c98508c499ca1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c499ca8 expref: -99 pid: 15579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179262.103249:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788179262.103251:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499b6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c499b74 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179262.103255:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5e00 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:3.0:1788179262.103257:0:14261:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499b6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c499b74 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179262.103261:0:14261:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c499b74 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788179262.103265:0:14261:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c499b74 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788179262.103267:0:14261:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788179262.103277:0:14261:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499b6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c499b74 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179262.103280:0:14261:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788179262.103283:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499b6d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c499b74 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179262.103287:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5e00/0xaa4c98508c499b6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c499b74 expref: -99 pid: 14906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179262.103303:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179262.103305:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179262.103307:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179262.103315:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179262.103328:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce136049-9565-40c1-979f-49dcc63d6657:3307:1875041472060288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788179262.103376:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179262.103404:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788179262.103410:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce136049-9565-40c1-979f-49dcc63d6657:3307:1875041472060416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788179262.103428:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179262.103450:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472060288 00000100:00100000:3.0:1788179262.103454:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472060288 00010000:00010000:3.0:1788179262.103468:0:14259:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc9137b5800/0xaa4c98508c499ca8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c499ca1 expref: 19 pid: 14269 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179262.103480:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472060416 00000100:00100000:3.0:1788179262.103481:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472060416 00010000:00010000:3.0:1788179262.103486:0:14259:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc91317ee00/0xaa4c98508c499b74 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c499b6d expref: 20 pid: 14268 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179262.103493:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788179262.103497:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f8ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce136049-9565-40c1-979f-49dcc63d6657+20:3307:x1875041472060288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788179262.103503:0:14259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179262.103505:0:14259:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc9137b5800/0xaa4c98508c499ca8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c499ca1 expref: 20 pid: 14269 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179262.103511:0:14259:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc9137b5800/0xaa4c98508c499ca8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c499ca1 expref: 20 pid: 14269 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179262.103530:0:14259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179262.103551:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f8ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce136049-9565-40c1-979f-49dcc63d6657+20:3307:x1875041472060288:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179262.103555:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788179262.103588:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788179262.103592:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce136049-9565-40c1-979f-49dcc63d6657+19:3307:x1875041472060416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788179262.103596:0:14259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179262.103599:0:14259:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc91317ee00/0xaa4c98508c499b74 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c499b6d expref: 19 pid: 14268 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179262.103604:0:14259:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc91317ee00/0xaa4c98508c499b74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c499b6d expref: 19 pid: 14268 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179262.103787:0:16290:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc935d07540 going to sleep for 11 seconds 00010000:00010000:1.0:1788179262.103811:0:16290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc91317f800/0xaa4c98508c499e06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746623ec expref: 12 pid: 14268 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179262.103824:0:16290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0f4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16290:1875041472059648:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788179262.103836:0:16290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc91317ea00/0xaa4c98508c499dce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x34c7c4247466238a expref: 11 pid: 14266 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179262.103845:0:16290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0f4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16290:1875041472059776:192.168.202.2@tcp:104: 00010000:00010000:1.0:1788179262.103878:0:16290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc9137b5800/0xaa4c98508c499ca8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c499ca1 expref: 19 pid: 14269 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179262.103971:0:14257:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788179262.103980:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472060160 00000100:00100000:0.0:1788179262.103983:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472060160 00000100:00100000:0.0:1788179262.103999:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788179262.104003:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc902fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce136049-9565-40c1-979f-49dcc63d6657+3:16290:x1875041472060160:12345-0@lo:104: 00010000:00010000:0.0:1788179262.104010:0:14257:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c499b20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c499b27 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179262.104096:0:14257:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788179262.104100:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc902fe4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce136049-9565-40c1-979f-49dcc63d6657+3:16290:x1875041472060160:12345-0@lo:104: Request processed in 97us (2558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179262.104104:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788179262.104143:0:15878:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788179262.104148:0:15878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c499b20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xaa4c98508c499b27 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179262.104155:0:15878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f400 already unused, calling callback (ffffffffc1c63c20) 10000000:00010000:0.0:1788179262.104158:0:15878:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c499b20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xaa4c98508c499b27 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179262.104165:0:15878:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c499b20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xaa4c98508c499b27 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788179262.104171:0:15878:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c499b20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xaa4c98508c499b27 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788179262.104176:0:15878:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788179262.104206:0:15878:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c499b20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c499b27 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179262.104212:0:15878:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788179262.104229:0:15878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c499b20 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c499b27 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179262.104235:0:15878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.102@tcp lock: ffff9bc91317f400/0xaa4c98508c499b20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xaa4c98508c499b27 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179262.104251:0:15878:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179262.104252:0:15878:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788179262.104254:0:15878:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179262.104263:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93a82e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce136049-9565-40c1-979f-49dcc63d6657:3305:1875041472060544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788179262.104283:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788179262.104359:0:14259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179262.104386:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce136049-9565-40c1-979f-49dcc63d6657+19:3307:x1875041472060416:12345-0@lo:103:ldlm_bl.0 Request processed in 792us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179262.104392:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788179262.104404:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472060544 00000100:00100000:3.0:1788179262.104408:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472060544 00010000:00010000:3.0:1788179262.104421:0:14259:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9bc9136c5c00/0xaa4c98508c499b27 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c499b20 expref: 19 pid: 14268 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179262.104430:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788179262.104434:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce136049-9565-40c1-979f-49dcc63d6657+19:3305:x1875041472060544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788179262.104439:0:14259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179262.104442:0:14259:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9bc9136c5c00/0xaa4c98508c499b27 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xaa4c98508c499b20 expref: 19 pid: 14268 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179262.104455:0:14259:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9bc9136c5c00/0xaa4c98508c499b27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xaa4c98508c499b20 expref: 19 pid: 14268 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179262.104464:0:14259:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9bc92f7ce600/0xaa4c98508c499e30 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179262.104470:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc92f7ce600/0xaa4c98508c499e30 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179262.104480:0:14259:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bc92f7ce600/0xaa4c98508c499e30 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179262.104484:0:14259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9bc92f7ce600/0xaa4c98508c499e30 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179262.104489:0:14259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9bc92f7ce600/0xaa4c98508c499e30 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179262.104492:0:14259:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9bc92f7ce600/0xaa4c98508c499e30 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179262.104495:0:14259:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92f7ce600 already unused, calling callback (ffffffffc1644220) 00010000:00010000:3.0:1788179262.104498:0:14259:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9bc92f7ce600/0xaa4c98508c499e30 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179262.104502:0:14259:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9bc92f7ce600/0xaa4c98508c499e30 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179262.104506:0:14259:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9bc92f7ce600/0xaa4c98508c499e30 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179262.104518:0:14259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179262.104547:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce136049-9565-40c1-979f-49dcc63d6657+19:3305:x1875041472060544:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179262.104551:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788179262.104570:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce136049-9565-40c1-979f-49dcc63d6657:3307:1875041472060416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788179262.104575:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce136049-9565-40c1-979f-49dcc63d6657:3307:1875041472060288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788179262.104669:0:16290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0f6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16290:1875041472059904:0@lo:104: 00010000:00010000:1.0:1788179262.104680:0:16290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc91317ee00/0xaa4c98508c499b74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c499b6d expref: 17 pid: 14268 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179262.104685:0:16290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0f5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16290:1875041472060032:0@lo:104: 00010000:00010000:1.0:1788179262.104689:0:16290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc9136c5c00/0xaa4c98508c499b27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xaa4c98508c499b20 expref: 16 pid: 14268 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179262.104706:0:16290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc935a22d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16290:1875041472060160:0@lo:104: 00010000:00010000:1.0:1788179262.104729:0:16290:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9bc92f7ce600/0xaa4c98508c499e30 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179262.104738:0:16290:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9bc92f7ce600/0xaa4c98508c499e30 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179262.104745:0:16290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9bc92f7ce600/0xaa4c98508c499e30 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179262.104762:0:16290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9bc92f7ce600/0xaa4c98508c499e30 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179262.106747:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93a82e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce136049-9565-40c1-979f-49dcc63d6657:3305:1875041472060544:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788179262.144048:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179263.180711:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179263.316307:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179263.316365:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451097472 00000100:00100000:1.0:1788179263.316377:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451097472 00000100:00100000:1.0:1788179263.316444:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 104 00000100:00100000:1.0:1788179263.316454:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fad5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+11:13716:x1875041451097472:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788179263.316472:0:14269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179263.316494:0:14269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc92f7ce600/0xaa4c98508c499e37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x34c7c4247466241d expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179263.316525:0:14269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc92f7ce600/0xaa4c98508c499e37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466241d expref: 12 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179263.316536:0:14269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc92f7ce600/0xaa4c98508c499e37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466241d expref: 12 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179263.316546:0:14269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc92f7ce600, rc 0) 00000100:00100000:1.0:1788179263.316624:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fad5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+12:13716:x1875041451097472:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 Request processed in 171us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179263.316631:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 104 00000100:00100000:0.0:1788179263.318890:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179263.318931:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451097600 00000100:00100000:0.0:1788179263.318942:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451097600 00000100:00100000:0.0:1788179263.318997:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 105 00000100:00100000:0.0:1788179263.319020:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fad6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+12:13716:x1875041451097600:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788179263.319342:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fad6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+12:13716:x1875041451097600:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 Request processed in 324us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179263.319348:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 105 00000100:00100000:0.0:1788179263.336534:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179263.336725:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451097728 00000100:00100000:3.0:1788179263.336735:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451097728 00000100:00100000:3.0:1788179263.336799:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 106 00000100:00100000:3.0:1788179263.336810:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+12:13716:x1875041451097728:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788179263.337270:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+12:13716:x1875041451097728:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 Request processed in 460us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179263.337279:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 106 00000100:00100000:2.0:1788179263.343747:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179263.343814:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451097856 00000100:00100000:0.0:1788179263.343827:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451097856 00000100:00100000:0.0:1788179263.343913:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 107 00000100:00100000:0.0:1788179263.343924:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+12:13716:x1875041451097856:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788179263.343944:0:14269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179263.343963:0:14269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc91317e200/0xaa4c98508c499e3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x34c7c42474662424 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179263.344007:0:14269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc91317e200/0xaa4c98508c499e3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662424 expref: 13 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179263.344019:0:14269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc91317e200/0xaa4c98508c499e3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662424 expref: 13 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179263.344028:0:14269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317e200, rc 0) 00000100:00100000:0.0:1788179263.344093:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+13:13716:x1875041451097856:12345-192.168.202.2@tcp:101:ll_cfg_requeue.0 Request processed in 170us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179263.344100:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 107 00000100:00100000:0.0:1788179263.346212:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179263.346285:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451097984 00000100:00100000:1.0:1788179263.346295:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451097984 00000100:00100000:1.0:1788179263.346342:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 108 00000100:00100000:1.0:1788179263.346351:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fad5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+13:13716:x1875041451097984:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788179263.346839:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fad5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+13:13716:x1875041451097984:12345-192.168.202.2@tcp:501:ll_cfg_requeue.0 Request processed in 486us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179263.346874:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 108 00000100:00100000:0.0:1788179263.356657:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179263.356701:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451098112 00000100:00100000:0.0:1788179263.356711:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451098112 00000100:00100000:0.0:1788179263.356769:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 109 00000100:00100000:0.0:1788179263.356778:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fad6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+13:13716:x1875041451098112:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788179263.357037:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fad6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+13:13716:x1875041451098112:12345-192.168.202.2@tcp:503:ll_cfg_requeue.0 Request processed in 259us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179263.357045:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 109 10000000:01000000:2.0:1788179263.623156:0:14271:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788179263.623164:0:14271:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bc905c14800 from 10 10000000:01000000:2.0:1788179263.623170:0:14271:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788179263.623219:0:14271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc920625400/0xaa4c98508c499e45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179263.623232:0:14271:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc920625400/0xaa4c98508c499e45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179263.623243:0:14271:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc920625400/0xaa4c98508c499e45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179263.623270:0:14271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc907039180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472060672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788179263.623339:0:14271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179263.623391:0:14271:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e49d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788179263.623416:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472060672 00000100:00100000:2.0:1788179263.623423:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472060672 00000100:00100000:2.0:1788179263.623470:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788179263.623488:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fad6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+16:14271:x1875041472060672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788179263.623503:0:14268:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179263.623516:0:14268:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc920625000/0xaa4c98508c499e4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c499e45 expref: -99 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179263.623540:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc920625000/0xaa4c98508c499e4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c499e45 expref: 17 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179263.623549:0:14268:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc920625000/0xaa4c98508c499e4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c499e45 expref: 17 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179263.623558:0:14268:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc920625000, rc 0) 00000100:00100000:2.0:1788179263.623751:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fad6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+17:14271:x1875041472060672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 263us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179263.623758:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788179263.623810:0:14271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc907039180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472060672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788179263.623824:0:14271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc920625400/0xaa4c98508c499e45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499e4c expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179263.623834:0:14271:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc920625400/0xaa4c98508c499e45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c499e4c expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179263.623905:0:14271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc907039180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472060800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788179263.623932:0:14271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179263.623949:0:14271:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e49d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788179263.623962:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472060800 00000100:00100000:2.0:1788179263.623966:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472060800 00000100:00100000:2.0:1788179263.623987:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788179263.624000:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fad7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+17:14271:x1875041472060800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788179263.624319:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fad7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+17:14271:x1875041472060800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 318us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179263.624327:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788179263.624360:0:14271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc907039180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472060800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788179263.624389:0:14271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc907039180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472060928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788179263.624428:0:14271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179263.624444:0:14271:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e49d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788179263.624455:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472060928 00000100:00100000:2.0:1788179263.624459:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472060928 00000100:00100000:2.0:1788179263.624478:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788179263.624484:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fad4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+17:14271:x1875041472060928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788179263.626292:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fad4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+17:14271:x1875041472060928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1798us (1854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179263.626306:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788179263.626380:0:14271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc907039180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472060928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788179263.633207:0:16347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788179263.636224:0:14271:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788179263.636262:0:14271:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788179263.636275:0:14271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc920625400/0xaa4c98508c499e45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499e4c expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179263.636288:0:14271:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc920625400/0xaa4c98508c499e45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499e4c expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788179263.636298:0:14271:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788179263.636301:0:14271:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bc903975800 from 10 10000000:01000000:3.0:1788179263.636303:0:14271:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788179263.636343:0:14271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5400/0xaa4c98508c499e53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179263.636360:0:14271:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5400/0xaa4c98508c499e53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179263.636377:0:14271:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5400/0xaa4c98508c499e53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179263.636405:0:14271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472061056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788179263.636479:0:14271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179263.636522:0:14271:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc93b4a0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788179263.638318:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472061056 00000100:00100000:2.0:1788179263.638332:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472061056 00000100:00100000:2.0:1788179263.638395:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788179263.638405:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fad6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+17:14271:x1875041472061056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788179263.638422:0:14268:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179263.638441:0:14268:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc920624200/0xaa4c98508c499e5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c499e53 expref: -99 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179263.638491:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc920624200/0xaa4c98508c499e5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c499e53 expref: 18 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179263.638501:0:14268:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc920624200/0xaa4c98508c499e5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c499e53 expref: 18 pid: 14268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179263.638511:0:14268:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc920624200, rc 0) 00000100:00100000:2.0:1788179263.638606:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fad6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+18:14271:x1875041472061056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 202us (2126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179263.638614:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788179263.638692:0:14271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472061056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788179263.638711:0:14271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5400/0xaa4c98508c499e53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499e5a expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179263.638721:0:14271:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5400/0xaa4c98508c499e53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c499e5a expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179263.638801:0:14271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc907039180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472061184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788179263.638837:0:14271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179263.638885:0:14271:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e49db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788179263.638900:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472061184 00000100:00100000:2.0:1788179263.638904:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472061184 00000100:00100000:2.0:1788179263.638929:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788179263.638935:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fad5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+18:14271:x1875041472061184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788179263.640282:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fad5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+18:14271:x1875041472061184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1341us (1438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179263.640304:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788179263.640364:0:14271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc907039180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472061184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788179263.640411:0:14271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc907039180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472061312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788179263.640452:0:14271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179263.640471:0:14271:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e49db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788179263.640487:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472061312 00000100:00100000:2.0:1788179263.640493:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472061312 00000100:00100000:2.0:1788179263.640523:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788179263.640530:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fad4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+18:14271:x1875041472061312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788179263.642916:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fad4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+18:14271:x1875041472061312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2375us (2453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179263.642932:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788179263.648428:0:14271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc907039180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472061312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788179263.650840:0:16349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788179263.650951:0:14271:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788179263.650980:0:14271:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788179263.654494:0:14271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5400/0xaa4c98508c499e53 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499e5a expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179263.654517:0:14271:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc9137b5400/0xaa4c98508c499e53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499e5a expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788179263.654530:0:14271:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788179263.654533:0:14271:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9bc93f796000 from 10 10000000:01000000:2.0:1788179263.654536:0:14271:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788179263.654579:0:14271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc920624800/0xaa4c98508c499e61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179263.654920:0:14271:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.102@tcp lock: ffff9bc920624800/0xaa4c98508c499e61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179263.654933:0:14271:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.102@tcp lock: ffff9bc920624800/0xaa4c98508c499e61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179263.654961:0:14271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc907039180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472061440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788179263.655805:0:14271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179263.655879:0:14271:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e49d180 going to sleep for 11 seconds 00000100:00100000:1.0:1788179263.655986:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472061440 00000100:00100000:1.0:1788179263.656666:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472061440 00000100:00100000:1.0:1788179263.656738:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788179263.656749:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93fad7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+18:14271:x1875041472061440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788179263.656767:0:14269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179263.656787:0:14269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9bc92f7ce000/0xaa4c98508c499e68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xaa4c98508c499e61 expref: -99 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179263.656815:0:14269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9bc92f7ce000/0xaa4c98508c499e68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xaa4c98508c499e61 expref: 19 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179263.656827:0:14269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9bc92f7ce000/0xaa4c98508c499e68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xaa4c98508c499e61 expref: 19 pid: 14269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179263.656836:0:14269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc92f7ce000, rc 0) 00000100:00100000:1.0:1788179263.656920:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93fad7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+19:14271:x1875041472061440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179263.656927:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788179263.658734:0:14271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc907039180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472061440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788179263.658764:0:14271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.102@tcp lock: ffff9bc920624800/0xaa4c98508c499e61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499e68 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179263.658776:0:14271:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.102@tcp lock: ffff9bc920624800/0xaa4c98508c499e61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xaa4c98508c499e68 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179263.658892:0:14271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc907039180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472061568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788179263.658950:0:14271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179263.659164:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472061568 00000100:00100000:1.0:1788179263.659171:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472061568 00000100:00100000:1.0:1788179263.659211:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788179263.659219:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+19:14271:x1875041472061568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788179263.659480:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+19:14271:x1875041472061568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179263.659487:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788179263.661255:0:14271:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e49d180 going to sleep for 11 seconds 00000100:00100000:2.0:1788179263.661299:0:14271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc907039180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472061568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788179263.661356:0:14271:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc907039180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472061696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788179263.661426:0:14271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179263.661467:0:14271:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e49d180 going to sleep for 11 seconds 00000100:00100000:2.0:1788179263.661500:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472061696 00000100:00100000:2.0:1788179263.661508:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472061696 00000100:00100000:2.0:1788179263.661563:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788179263.661571:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+19:14271:x1875041472061696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788179263.667361:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce136049-9565-40c1-979f-49dcc63d6657+19:14271:x1875041472061696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 5780us (5924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179263.667378:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788179263.669833:0:14271:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc907039180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce136049-9565-40c1-979f-49dcc63d6657:14271:1875041472061696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788179263.677445:0:16350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788179263.677781:0:14271:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788179263.677821:0:14271:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788179263.677833:0:14271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.102@tcp lock: ffff9bc920624800/0xaa4c98508c499e61 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499e68 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179263.677845:0:14271:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.102@tcp lock: ffff9bc920624800/0xaa4c98508c499e61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xaa4c98508c499e68 expref: -99 pid: 14271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179263.682294:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc90703b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472061824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788179263.682367:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179263.682452:0:14912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472061824 00000100:00100000:2.0:1788179263.682461:0:14912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472061824 00000100:00100000:2.0:1788179263.682521:0:14912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788179263.682531:0:14912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472061824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788179263.682572:0:14912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788179263.682622:0:14912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472061824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179263.682629:0:14912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788179263.682649:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788179263.683061:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc90703b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472061824:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788179264.192280:0:15878:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179265.216037:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788179265.728118:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472062080:0@lo:400:kworker.0 00000100:00100000:1.0:1788179265.728193:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179265.728395:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce136049-9565-40c1-979f-49dcc63d6657:3307:1875041472061952:0@lo:400:kworker.0 00000100:00100000:3.0:1788179265.728430:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179265.728485:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875041472062464:0@lo:400:kworker.0 00000100:00100000:3.0:1788179265.728507:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179265.728529:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788179265.728534:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041472062592:0@lo:400:kworker.0 00000100:00100000:3.0:1788179265.728553:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788179265.728589:0:14908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472062080 00000100:00100000:3.0:1788179265.728595:0:14908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472062080 00000100:00100000:3.0:1788179265.728708:0:14908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788179265.728720:0:14908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472062080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179265.728766:0:14908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472062080:12345-0@lo:400:kworker.0 Request processed in 50us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179265.728773:0:14908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788179265.728804:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472061952 00000100:00100000:3.0:1788179265.728821:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472061952 00000100:00100000:3.0:1788179265.728867:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788179265.728874:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+19:3307:x1875041472061952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788179265.728906:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce136049-9565-40c1-979f-49dcc63d6657+19:3307:x1875041472061952:12345-0@lo:400:kworker.0 Request processed in 33us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179265.728912:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788179265.728949:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce136049-9565-40c1-979f-49dcc63d6657:3307:1875041472061952:0@lo:400:kworker.0 00000100:00100000:1.0:1788179265.729636:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472062080:0@lo:400:kworker.0 00000100:00100000:2.0:1788179265.730215:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472062208:0@lo:400:kworker.0 00000100:00100000:2.0:1788179265.730289:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179265.730328:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc90703b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472062720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788179265.730351:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179265.730380:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788179265.730386:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e8d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041472062336:0@lo:400:kworker.0 00000100:00100000:2.0:1788179265.730410:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179265.730446:0:16052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472062464 00000100:00100000:2.0:1788179265.730453:0:16052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472062464 00000100:00100000:2.0:1788179265.730501:0:16052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472062592 00000100:00100000:2.0:1788179265.730505:0:16052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472062592 00000100:00100000:2.0:1788179265.730521:0:16052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472062336 00000100:00100000:2.0:1788179265.730525:0:16052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472062336 00000100:00100000:2.0:1788179265.730545:0:16052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788179265.730585:0:14907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472062208 00000100:00100000:1.0:1788179265.730585:0:14912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472062720 00000100:00100000:3.0:1788179265.730589:0:14907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472062208 00000100:00100000:1.0:1788179265.730589:0:14912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472062720 00000100:00100000:3.0:1788179265.730618:0:14907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788179265.730618:0:14912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788179265.730625:0:14907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90703a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875041472062208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179265.730626:0:14912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90703a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875041472062720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788179265.730677:0:14912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788179265.730679:0:14907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90703a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875041472062208:12345-0@lo:400:kworker.0 Request processed in 55us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179265.730685:0:14907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788179265.730708:0:14912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90703a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472062720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179265.730715:0:14912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788179265.730745:0:16052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875041472062464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179265.730796:0:16052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875041472062464:12345-0@lo:400:kworker.0 Request processed in 244us (2287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179265.733122:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788179265.733164:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875041472062592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179265.733256:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875041472062592:12345-0@lo:400:kworker.0 Request processed in 103us (4701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179265.733263:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788179265.733292:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788179265.733300:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041472062336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788179265.733331:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875041472062336:12345-0@lo:400:kworker.0 Request processed in 32us (2920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179265.733337:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788179265.733808:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788179265.733889:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788179265.733892:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788179265.733960:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875041472062336:0@lo:400:kworker.0 00000100:00100000:3.0:1788179265.733977:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472062208:0@lo:400:kworker.0 00000100:00100000:3.0:1788179265.734641:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc90703b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472062720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788179265.734722:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1875041472062592:0@lo:400:kworker.0 00000100:00100000:3.0:1788179265.734734:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e8d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875041472062464:0@lo:400:kworker.0 00000100:00100000:0.0:1788179265.735124:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179265.735228:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451098240 00000100:00100000:0.0:1788179265.735235:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451098240 00000100:00100000:0.0:1788179265.735283:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:0.0:1788179265.735292:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+6:14372:x1875041451098240:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788179265.735308:0:14276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179265.735330:0:14276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499e6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466242b expref: -99 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.735394:0:14276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499e76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179265.735769:0:16052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788179265.735957:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788179265.736255:0:14276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499e76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.736270:0:14276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499e76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.736290:0:14276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ea00/0xaa4c98508c499e7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.736312:0:14276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ea00/0xaa4c98508c499e7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.736319:0:14276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ea00/0xaa4c98508c499e7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.736833:0:14276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c499e84 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.736843:0:14276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c499e84 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.736883:0:14276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c499e84 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179265.736969:0:14276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1788179265.736974:0:14276:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788179265.737069:0:14276:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c499e84 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.737082:0:14276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499e76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.737089:0:14276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499e76 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.737096:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499e76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.737102:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f800 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179265.737106:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499e76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.737121:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499e76 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.737134:0:14276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc9062cb300) 00010000:00010000:0.0:1788179265.737137:0:14276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179265.737142:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499e76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.737147:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499e76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.737160:0:14276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ea00/0xaa4c98508c499e7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.737166:0:14276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ea00/0xaa4c98508c499e7d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.737171:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ea00/0xaa4c98508c499e7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.737177:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317ea00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179265.737180:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ea00/0xaa4c98508c499e7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.737187:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ea00/0xaa4c98508c499e7d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.737194:0:14276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9bc9062cb600) 00010000:00010000:0.0:1788179265.737197:0:14276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179265.737201:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ea00/0xaa4c98508c499e7d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.737216:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ea00/0xaa4c98508c499e7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.737256:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499e6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466242b expref: 8 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.737271:0:14276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ee00/0xaa4c98508c499e84 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466242b expref: 7 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.737280:0:14276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bc9062cb100) 00010000:00010000:0.0:1788179265.737282:0:14276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788179265.737284:0:14276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317ee00, rc 0) 00000100:00100000:0.0:1788179265.737358:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+7:14372:x1875041451098240:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 2064us (2234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179265.737365:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:2.0:1788179265.749241:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179265.749349:0:16052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451098496 00000100:00100000:0.0:1788179265.749360:0:16052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451098496 00000100:00100000:0.0:1788179265.749422:0:16052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:0.0:1788179265.749433:0:16052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:baf94a59-5a83-4c54-8a75-155abe3189eb+7:14372:x1875041451098496:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788179265.749453:0:16052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179265.749472:0:16052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499e8b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662432 expref: -99 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.749545:0:16052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ea00/0xaa4c98508c499e92 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.749560:0:16052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ea00/0xaa4c98508c499e92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.749597:0:16052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ea00/0xaa4c98508c499e92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.749670:0:16052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499e99 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.749679:0:16052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499e99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.749686:0:16052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499e99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.750246:0:16052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c499ea0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.750256:0:16052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c499ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.750263:0:16052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c499ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179265.750274:0:16052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1788179265.750529:0:16052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ea00/0xaa4c98508c499e92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.750538:0:16052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ea00/0xaa4c98508c499e92 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.750543:0:16052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ea00/0xaa4c98508c499e92 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.750549:0:16052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317ea00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179265.750559:0:16052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ea00/0xaa4c98508c499e92 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.750567:0:16052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ea00/0xaa4c98508c499e92 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.750579:0:16052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9bc9062cb100) 00010000:00010000:0.0:1788179265.750582:0:16052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179265.750586:0:16052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ea00/0xaa4c98508c499e92 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.750592:0:16052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ea00/0xaa4c98508c499e92 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.750605:0:16052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499e99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.750611:0:16052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499e99 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.750617:0:16052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499e99 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.750622:0:16052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f800 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179265.750625:0:16052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499e99 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.750630:0:16052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499e99 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.750674:0:16052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9bc9062cb600) 00010000:00010000:0.0:1788179265.750677:0:16052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179265.750689:0:16052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499e99 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.750694:0:16052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499e99 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.751094:0:16052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499e8b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662432 expref: 10 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.751110:0:16052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f400/0xaa4c98508c499ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662432 expref: 9 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.751118:0:16052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bc9062cba00) 00010000:00010000:0.0:1788179265.751120:0:16052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179265.751123:0:16052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317f400, rc 0) 00000100:00100000:0.0:1788179265.751188:0:16052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:baf94a59-5a83-4c54-8a75-155abe3189eb+9:14372:x1875041451098496:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 1756us (1956us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788179265.751198:0:16052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:1.0:1788179265.756485:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179265.756621:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451098624 00000100:00100000:2.0:1788179265.756631:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451098624 00000100:00100000:2.0:1788179265.756709:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:2.0:1788179265.756720:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+9:14372:x1875041451098624:12345-192.168.202.2@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788179265.756840:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+9:14372:x1875041451098624:12345-192.168.202.2@tcp:59:lhsmtool_posix.0 Request processed in 122us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179265.756883:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:1.0:1788179265.794805:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179265.795693:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451098752 00000100:00100000:2.0:1788179265.795716:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451098752 00000100:00100000:2.0:1788179265.795782:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:2.0:1788179265.795792:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+9:14378:x1875041451098752:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788179265.795811:0:14275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179265.795835:0:14275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624400/0xaa4c98508c499eae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662439 expref: -99 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.795947:0:14275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625e00/0xaa4c98508c499eb5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.795962:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625e00/0xaa4c98508c499eb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.795975:0:14275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625e00/0xaa4c98508c499eb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.795990:0:14275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c499ebc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.795998:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c499ebc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.796004:0:14275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c499ebc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.796373:0:14275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625e00/0xaa4c98508c499eb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.796382:0:14275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625e00/0xaa4c98508c499eb5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.796389:0:14275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625e00/0xaa4c98508c499eb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.796400:0:14275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920625e00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179265.796405:0:14275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625e00/0xaa4c98508c499eb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.796413:0:14275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625e00/0xaa4c98508c499eb5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.796425:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc9062cb300) 00010000:00010000:2.0:1788179265.796428:0:14275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179265.796433:0:14275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625e00/0xaa4c98508c499eb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.796439:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625e00/0xaa4c98508c499eb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.796456:0:14275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c499ebc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.796465:0:14275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c499ebc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.796472:0:14275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c499ebc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.796478:0:14275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920624000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179265.796481:0:14275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c499ebc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.796487:0:14275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c499ebc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.796504:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bc910f79c00) 00010000:00010000:2.0:1788179265.796506:0:14275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179265.796509:0:14275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c499ebc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.796515:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c499ebc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.796545:0:14275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624400/0xaa4c98508c499eae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662439 expref: 10 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.796555:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc9062cb300) 00010000:00010000:2.0:1788179265.796558:0:14275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179265.796561:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624400/0xaa4c98508c499eae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662439 expref: 10 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.796570:0:14275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc920624400, rc 0) 00000100:00100000:3.0:1788179265.796700:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+9:14378:x1875041451098752:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 907us (1901us total) trans 0 rc 301/301 00000100:00100000:3.0:1788179265.796719:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:3.0:1788179265.804526:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179265.810004:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451098880 00000100:00100000:2.0:1788179265.810019:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451098880 00000100:00100000:2.0:1788179265.810095:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:2.0:1788179265.810107:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:baf94a59-5a83-4c54-8a75-155abe3189eb+9:14378:x1875041451098880:12345-192.168.202.2@tcp:700:lfs.0 00000100:00100000:2.0:1788179265.810210:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:baf94a59-5a83-4c54-8a75-155abe3189eb+9:14378:x1875041451098880:12345-192.168.202.2@tcp:700:lfs.0 Request processed in 105us (5691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179265.810218:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:1.0:1788179265.812922:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179265.813009:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451099136 00000100:00100000:2.0:1788179265.813018:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451099136 00000100:00100000:2.0:1788179265.813066:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 19 00000100:00100000:2.0:1788179265.813091:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+9:14378:x1875041451099136:12345-192.168.202.2@tcp:36:lfs.0 00010000:00010000:2.0:1788179265.813149:0:14274:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179265.813178:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e800/0xaa4c98508c499df1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746623b4 expref: 9 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.813197:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc9062cb300) 00010000:00010000:2.0:1788179265.813202:0:14274:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788179265.813497:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624400/0xaa4c98508c499ec3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.813513:0:14274:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499e29 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662416 expref: 5 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.813521:0:14274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624400/0xaa4c98508c499ec3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.813552:0:14274:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499e29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662416 expref: 5 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.813564:0:14274:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499e29 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662416 expref: 5 pid: 14276 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179265.813589:0:14274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc90703aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14274:1875041472062848:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788179265.813690:0:14274:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e49d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788179265.815523:0:14274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc90703aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14274:1875041472062848:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788179265.815550:0:14274:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624400/0xaa4c98508c499ec3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179265.815919:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179265.816081:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451099264 00000100:00100000:3.0:1788179265.816089:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451099264 00010000:00010000:3.0:1788179265.816136:0:14259:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499e29 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662416 expref: 6 pid: 14276 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179265.816177:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:3.0:1788179265.816186:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803603800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:173e045c-d692-4828-8fa4-7aaba778738a+6:2357:x1875041451099264:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788179265.816199:0:14259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179265.816206:0:14259:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499e29 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662416 expref: 6 pid: 14276 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179265.816216:0:14259:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499e29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662416 expref: 6 pid: 14276 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179265.816237:0:14259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499e29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662416 expref: 6 pid: 14276 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179265.816252:0:14259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc9062cb300) 00010000:00010000:3.0:1788179265.816258:0:14259:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624400/0xaa4c98508c499ec3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179265.816266:0:14259:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624400/0xaa4c98508c499ec3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179265.816274:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624400/0xaa4c98508c499ec3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179265.816351:0:14259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179265.816406:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803603800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:173e045c-d692-4828-8fa4-7aaba778738a+5:2357:x1875041451099264:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 221us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179265.816411:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00010000:00010000:1.0:1788179265.816448:0:14274:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624400/0xaa4c98508c499ec3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179265.816455:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624400/0xaa4c98508c499ec3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179265.816481:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c499eca lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179265.816490:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c499eca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179265.816498:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c499eca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788179265.816695:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1788179265.821185:0:14274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1788179265.821208:0:14274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624400/0xaa4c98508c499ec3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179265.821217:0:14274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624400/0xaa4c98508c499ec3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179265.821222:0:14274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624400/0xaa4c98508c499ec3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179265.821226:0:14274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920624400 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179265.821229:0:14274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624400/0xaa4c98508c499ec3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179265.821235:0:14274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624400/0xaa4c98508c499ec3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179265.821248:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc9062cb300) 00010000:00010000:1.0:1788179265.821250:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179265.821253:0:14274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624400/0xaa4c98508c499ec3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179265.821258:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624400/0xaa4c98508c499ec3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788179265.821275:0:14274:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cb092e22 reply state 00000000d9868d23 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c499eca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179265.821281:0:14274:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788179265.821375:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+10:14378:x1875041451099136:12345-192.168.202.2@tcp:36:lfs.0 Request processed in 8284us (8461us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788179265.821392:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 19 00010000:00010000:3.0:1788179265.826473:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c499eca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179265.826492:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c499eca lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179265.826500:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c499eca lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179265.826510:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92f7cfe00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179265.826514:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c499eca lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179265.826528:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c499eca lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179265.826544:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bc920ca7600) 00010000:00010000:3.0:1788179265.826547:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179265.826551:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c499eca lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179265.826557:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c499eca lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179265.952585:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179265.953299:0:16052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451099392 00000100:00100000:2.0:1788179265.953312:0:16052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451099392 00000100:00100000:2.0:1788179265.953390:0:16052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:2.0:1788179265.953402:0:16052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:baf94a59-5a83-4c54-8a75-155abe3189eb+9:14386:x1875041451099392:12345-192.168.202.2@tcp:101:lctl.0 00010000:00010000:2.0:1788179265.953426:0:16052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179265.953451:0:16052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c499ed1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662440 expref: -99 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.953519:0:16052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625e00/0xaa4c98508c499ed8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.953533:0:16052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625e00/0xaa4c98508c499ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.953546:0:16052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625e00/0xaa4c98508c499ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179265.953610:0:16052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788179265.953614:0:16052:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1788179265.953670:0:16052:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625e00/0xaa4c98508c499ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.953699:0:16052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c499ed1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662440 expref: 11 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.953721:0:16052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625e00/0xaa4c98508c499ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662440 expref: 10 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179265.953750:0:16052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc910f79c00) 00010000:00010000:2.0:1788179265.953753:0:16052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788179265.953757:0:16052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc920625e00, rc 0) 00000100:00100000:2.0:1788179265.953841:0:16052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:baf94a59-5a83-4c54-8a75-155abe3189eb+10:14386:x1875041451099392:12345-192.168.202.2@tcp:101:lctl.0 Request processed in 441us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179265.953896:0:16052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:1.0:1788179265.987924:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179265.988026:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451099520 00000100:00100000:0.0:1788179265.988037:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451099520 00000100:00100000:0.0:1788179265.988110:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:0.0:1788179265.988121:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173e045c-d692-4828-8fa4-7aaba778738a+5:14387:x1875041451099520:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788179265.988143:0:14276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179265.988165:0:14276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499edf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662447 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.988233:0:14276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ea00/0xaa4c98508c499ee6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.988264:0:14276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ea00/0xaa4c98508c499ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.988276:0:14276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ea00/0xaa4c98508c499ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179265.988826:0:14276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788179265.988831:0:14276:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1788179265.988913:0:14276:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ea00/0xaa4c98508c499ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.988946:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499edf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662447 expref: 7 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.988968:0:14276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317ea00/0xaa4c98508c499ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662447 expref: 6 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179265.988976:0:14276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc910f79c00) 00010000:00010000:0.0:1788179265.988979:0:14276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788179265.988983:0:14276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317ea00, rc 0) 00000100:00100000:0.0:1788179265.989065:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173e045c-d692-4828-8fa4-7aaba778738a+6:14387:x1875041451099520:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 946us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179265.989074:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:0.0:1788179266.002252:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179266.002381:0:16052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451099648 00000100:00100000:2.0:1788179266.002392:0:16052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451099648 00000100:00100000:2.0:1788179266.002456:0:16052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:2.0:1788179266.002467:0:16052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173e045c-d692-4828-8fa4-7aaba778738a+6:14387:x1875041451099648:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788179266.002488:0:16052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179266.002511:0:16052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c499eed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466244e expref: -99 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.002575:0:16052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499ef4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.002589:0:16052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499ef4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.002601:0:16052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499ef4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.002614:0:16052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499efb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.002620:0:16052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499efb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.002643:0:16052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499efb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.002797:0:16052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625a00/0xaa4c98508c499f02 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.002805:0:16052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625a00/0xaa4c98508c499f02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.002811:0:16052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625a00/0xaa4c98508c499f02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179266.002879:0:16052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788179266.002883:0:16052:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788179266.002904:0:16052:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625a00/0xaa4c98508c499f02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.002915:0:16052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499ef4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.002921:0:16052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499ef4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.002927:0:16052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499ef4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.002932:0:16052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920625c00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179266.002936:0:16052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499ef4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.002942:0:16052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499ef4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.002960:0:16052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc910f79c00) 00010000:00010000:2.0:1788179266.002963:0:16052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179266.002967:0:16052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499ef4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.002973:0:16052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499ef4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.003001:0:16052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499efb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.003007:0:16052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499efb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.003012:0:16052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499efb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.003017:0:16052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920624c00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179266.003019:0:16052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499efb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.003025:0:16052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499efb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.003032:0:16052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bc910f79600) 00010000:00010000:2.0:1788179266.003035:0:16052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179266.003038:0:16052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499efb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.003043:0:16052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499efb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.003083:0:16052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c499eed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466244e expref: 8 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.003095:0:16052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625a00/0xaa4c98508c499f02 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466244e expref: 7 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.003103:0:16052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bc910f79700) 00010000:00010000:2.0:1788179266.003105:0:16052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788179266.003107:0:16052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc920625a00, rc 0) 00000100:00100000:2.0:1788179266.003177:0:16052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173e045c-d692-4828-8fa4-7aaba778738a+7:14387:x1875041451099648:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 712us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179266.003185:0:16052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:3.0:1788179266.013007:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179266.013274:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451099904 00000100:00100000:0.0:1788179266.013285:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451099904 00000100:00100000:0.0:1788179266.013359:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:0.0:1788179266.013369:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173e045c-d692-4828-8fa4-7aaba778738a+7:14387:x1875041451099904:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788179266.013406:0:14276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179266.013427:0:14276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499f09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662455 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179266.013541:0:14276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788179266.013675:0:14276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499f09 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662455 expref: 9 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.013691:0:14276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc910f79c00) 00010000:00010000:0.0:1788179266.013694:0:14276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788179266.013699:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499f09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662455 expref: 9 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.013715:0:14276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317fa00, rc 0) 00000100:00100000:0.0:1788179266.013788:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173e045c-d692-4828-8fa4-7aaba778738a+8:14387:x1875041451099904:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 420us (810us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788179266.013795:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:1.0:1788179266.022956:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179266.023306:0:16052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451100160 00000100:00100000:2.0:1788179266.023316:0:16052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451100160 00000100:00100000:2.0:1788179266.023380:0:16052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 24 00000100:00100000:2.0:1788179266.023392:0:16052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173e045c-d692-4828-8fa4-7aaba778738a+8:14387:x1875041451100160:12345-192.168.202.2@tcp:36:lfs.0 00010000:00010000:2.0:1788179266.023447:0:16052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179266.023475:0:16052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625a00/0xaa4c98508c499f02 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466244e expref: 8 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.023496:0:16052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bc910f79700) 00010000:00010000:2.0:1788179266.023506:0:16052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788179266.023531:0:16052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499f17 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.023544:0:16052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499f17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.023569:0:16052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499f17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788179266.023801:0:16052:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000072b3f12b reply state 0000000048cb0187 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499f17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179266.023811:0:16052:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788179266.023825:0:16052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1788179266.023959:0:16052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173e045c-d692-4828-8fa4-7aaba778738a+9:14387:x1875041451100160:12345-192.168.202.2@tcp:36:lfs.0 Request processed in 570us (1013us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788179266.023966:0:16052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 24 00010000:00010000:1.0:1788179266.028418:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499f17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179266.028438:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499f17 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179266.028445:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499f17 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179266.028450:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920624c00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179266.028455:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499f17 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179266.028462:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499f17 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179266.028477:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bc910f79600) 00010000:00010000:1.0:1788179266.028481:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788179266.028485:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499f17 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179266.028490:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499f17 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179266.029420:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179266.029485:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451100416 00000100:00100000:0.0:1788179266.029497:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451100416 00000100:00100000:0.0:1788179266.029557:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:0.0:1788179266.029577:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173e045c-d692-4828-8fa4-7aaba778738a+8:14387:x1875041451100416:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:0.0:1788179266.029954:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173e045c-d692-4828-8fa4-7aaba778738a+9:14387:x1875041451100416:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 388us (910us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788179266.029962:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:2.0:1788179266.032733:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179266.033360:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451100672 00000100:00100000:0.0:1788179266.033372:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451100672 00000100:00100000:0.0:1788179266.033437:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:0.0:1788179266.033462:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90703aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173e045c-d692-4828-8fa4-7aaba778738a+9:14387:x1875041451100672:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788179266.033486:0:14276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179266.033507:0:14276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499f1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466245c expref: -99 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.033817:0:14276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499f25 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.033834:0:14276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499f25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.033846:0:14276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499f25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.033880:0:14276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499f2c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.033888:0:14276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499f2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.033895:0:14276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499f2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179266.034152:0:14276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788179266.034246:0:14276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499f25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.034253:0:14276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499f25 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.034258:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499f25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.034274:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f800 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179266.034278:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499f25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.034284:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499f25 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.034295:0:14276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc910f79c00) 00010000:00010000:0.0:1788179266.034298:0:14276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179266.034303:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499f25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.034308:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499f25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.034320:0:14276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499f2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.034325:0:14276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499f2c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.034330:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499f2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.034334:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:0.0:1788179266.034337:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499f2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.034342:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499f2c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.034356:0:14276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bc9062cb600) 00010000:00010000:0.0:1788179266.034359:0:14276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788179266.034361:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499f2c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.034367:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499f2c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.034406:0:14276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499f1e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466245c expref: 11 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.034416:0:14276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc910f79c00) 00010000:00010000:0.0:1788179266.034418:0:14276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788179266.034435:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499f1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466245c expref: 11 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.034445:0:14276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317fa00, rc 0) 00000100:00100000:0.0:1788179266.034514:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90703aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173e045c-d692-4828-8fa4-7aaba778738a+10:14387:x1875041451100672:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 1053us (1787us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1788179266.034522:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 25 00000100:00100000:1.0:1788179266.041215:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179266.048248:0:16052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451100800 00000100:00100000:2.0:1788179266.048263:0:16052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451100800 00000100:00100000:2.0:1788179266.048336:0:16052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00100000:2.0:1788179266.048347:0:16052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173e045c-d692-4828-8fa4-7aaba778738a+10:14387:x1875041451100800:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788179266.048370:0:16052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179266.048396:0:16052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499f3a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662463 expref: -99 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.048482:0:16052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625600/0xaa4c98508c499f41 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.048496:0:16052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625600/0xaa4c98508c499f41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.048508:0:16052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625600/0xaa4c98508c499f41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179266.048586:0:16052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788179266.048591:0:16052:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788179266.048616:0:16052:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625600/0xaa4c98508c499f41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.048653:0:16052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499f3a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662463 expref: 12 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.048682:0:16052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625600/0xaa4c98508c499f41 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662463 expref: 11 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.048692:0:16052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bc910f79700) 00010000:00010000:2.0:1788179266.048695:0:16052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788179266.048698:0:16052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc920625600, rc 0) 00000100:00100000:2.0:1788179266.048765:0:16052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173e045c-d692-4828-8fa4-7aaba778738a+11:14387:x1875041451100800:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 420us (7561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179266.048773:0:16052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 26 00000100:00100000:1.0:1788179266.062314:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179266.065267:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451100928 00000100:00100000:0.0:1788179266.065282:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451100928 00000100:00100000:0.0:1788179266.065397:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:0.0:1788179266.065409:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173e045c-d692-4828-8fa4-7aaba778738a+11:14387:x1875041451100928:12345-192.168.202.2@tcp:37:lfs.0 00000100:00100000:1.0:1788179266.071047:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173e045c-d692-4828-8fa4-7aaba778738a+11:14387:x1875041451100928:12345-192.168.202.2@tcp:37:lfs.0 Request processed in 5628us (8730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179266.071067:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:1.0:1788179266.077226:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179266.080787:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451101184 00000100:00100000:2.0:1788179266.080804:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451101184 00000100:00100000:0.0:1788179266.083129:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:0.0:1788179266.083154:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc922129050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173e045c-d692-4828-8fa4-7aaba778738a+11:14387:x1875041451101184:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:0.0:1788179266.083463:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc922129050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173e045c-d692-4828-8fa4-7aaba778738a+12:14387:x1875041451101184:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 321us (6246us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788179266.083471:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:0.0:1788179266.118250:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179266.118391:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451101312 00000100:00100000:2.0:1788179266.118400:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451101312 00000100:00100000:2.0:1788179266.118453:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:2.0:1788179266.118461:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+10:14393:x1875041451101312:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1788179266.118480:0:14276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179266.118497:0:14276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624600/0xaa4c98508c499f48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466246a expref: -99 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.118593:0:14276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625200/0xaa4c98508c499f4f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.118607:0:14276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625200/0xaa4c98508c499f4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.118620:0:14276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625200/0xaa4c98508c499f4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.118634:0:14276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499f56 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.118640:0:14276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499f56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.118647:0:14276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499f56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.118766:0:14276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625a00/0xaa4c98508c499f5d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.118775:0:14276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625a00/0xaa4c98508c499f5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.118782:0:14276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625a00/0xaa4c98508c499f5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179266.118816:0:14276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788179266.118819:0:14276:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788179266.118905:0:14276:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625a00/0xaa4c98508c499f5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.118930:0:14276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625200/0xaa4c98508c499f4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.118936:0:14276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625200/0xaa4c98508c499f4f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.118943:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625200/0xaa4c98508c499f4f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.118949:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920625200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179266.118954:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625200/0xaa4c98508c499f4f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.118962:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625200/0xaa4c98508c499f4f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.118973:0:14276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc910f79c00) 00010000:00010000:2.0:1788179266.118975:0:14276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179266.118979:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625200/0xaa4c98508c499f4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.118985:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625200/0xaa4c98508c499f4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.119000:0:14276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499f56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.119005:0:14276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499f56 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.119010:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499f56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.119022:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920625c00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179266.119025:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499f56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.119032:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499f56 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.119039:0:14276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9bc910f79d00) 00010000:00010000:2.0:1788179266.119041:0:14276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179266.119043:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499f56 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.119047:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499f56 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.119071:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624600/0xaa4c98508c499f48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466246a expref: 12 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.119080:0:14276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625a00/0xaa4c98508c499f5d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466246a expref: 11 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.119085:0:14276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bc910f79700) 00010000:00010000:2.0:1788179266.119086:0:14276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788179266.119088:0:14276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc920625a00, rc 0) 00000100:00100000:2.0:1788179266.119158:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+11:14393:x1875041451101312:12345-192.168.202.2@tcp:101:bash.0 Request processed in 697us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179266.119165:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 27 00000100:00100000:2.0:1788179266.123593:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179266.123744:0:16052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451101568 00000100:00100000:0.0:1788179266.123753:0:16052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451101568 00000100:00100000:0.0:1788179266.123809:0:16052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:0.0:1788179266.123820:0:16052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90703ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:baf94a59-5a83-4c54-8a75-155abe3189eb+11:14393:x1875041451101568:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:0.0:1788179266.123875:0:16052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179266.123912:0:16052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499f64 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662471 expref: -99 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.124259:0:16052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e800/0xaa4c98508c499f6b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.124271:0:16052:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625600/0xaa4c98508c499f41 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662463 expref: 11 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.124277:0:16052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e800/0xaa4c98508c499f6b lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.124307:0:16052:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625600/0xaa4c98508c499f41 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662463 expref: 11 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.124318:0:16052:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625600/0xaa4c98508c499f41 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662463 expref: 11 pid: 16052 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179266.124328:0:16052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93a82f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16052:1875041472062976:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788179266.124459:0:16052:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc90f735780 going to sleep for 11 seconds 00000100:00100000:0.0:1788179266.130212:0:16052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93a82f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16052:1875041472062976:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788179266.130238:0:16052:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e800/0xaa4c98508c499f6b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179266.130681:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179266.130758:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451101696 00000100:00100000:0.0:1788179266.130766:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451101696 00010000:00010000:0.0:1788179266.130805:0:14260:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625600/0xaa4c98508c499f41 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662463 expref: 12 pid: 16052 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179266.130844:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:0.0:1788179266.130891:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907039880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173e045c-d692-4828-8fa4-7aaba778738a+12:2357:x1875041451101696:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179266.130908:0:14260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179266.130916:0:14260:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625600/0xaa4c98508c499f41 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662463 expref: 12 pid: 16052 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.130928:0:14260:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625600/0xaa4c98508c499f41 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662463 expref: 12 pid: 16052 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.130947:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625600/0xaa4c98508c499f41 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662463 expref: 12 pid: 16052 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.130961:0:14260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bc910f79700) 00010000:00010000:0.0:1788179266.130964:0:14260:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e800/0xaa4c98508c499f6b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.130972:0:14260:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e800/0xaa4c98508c499f6b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.130994:0:14260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e800/0xaa4c98508c499f6b lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.131018:0:14260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179266.131063:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907039880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173e045c-d692-4828-8fa4-7aaba778738a+11:2357:x1875041451101696:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 175us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179266.131069:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00010000:00010000:2.0:1788179266.131224:0:16052:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e800/0xaa4c98508c499f6b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.131230:0:16052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e800/0xaa4c98508c499f6b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.131249:0:16052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499f72 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.131255:0:16052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499f72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.131260:0:16052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499f72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.131925:0:16052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c499f79 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.131934:0:16052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c499f79 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.131939:0:16052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c499f79 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179266.131947:0:16052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788179266.131970:0:16052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e800/0xaa4c98508c499f6b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.131975:0:16052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e800/0xaa4c98508c499f6b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.131981:0:16052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e800/0xaa4c98508c499f6b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.131993:0:16052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317e800 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179266.131997:0:16052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e800/0xaa4c98508c499f6b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.132004:0:16052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e800/0xaa4c98508c499f6b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.132014:0:16052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bc910f79700) 00010000:00010000:2.0:1788179266.132017:0:16052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179266.132021:0:16052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e800/0xaa4c98508c499f6b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.132027:0:16052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e800/0xaa4c98508c499f6b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788179266.132038:0:16052:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c01fa285 reply state 000000003870b84a transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499f72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179266.132045:0:16052:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788179266.132071:0:16052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499f64 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662471 expref: 14 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.132082:0:16052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c499f79 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662471 expref: 13 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.132087:0:16052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bc910f79300) 00010000:00010000:2.0:1788179266.132088:0:16052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788179266.132090:0:16052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc920624000, rc 0) 00000100:00100000:2.0:1788179266.132126:0:16052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90703ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:baf94a59-5a83-4c54-8a75-155abe3189eb+14:14393:x1875041451101568:12345-192.168.202.2@tcp:101:bash.0 Request processed in 8309us (8547us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788179266.132139:0:16052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 28 00010000:00010000:3.0:1788179266.142096:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499f72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179266.142125:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499f72 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179266.142134:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499f72 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179266.142140:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920624c00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179266.142145:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499f72 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179266.142153:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499f72 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179266.142171:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9bc910f79000) 00010000:00010000:3.0:1788179266.142174:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179266.142179:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499f72 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179266.142186:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c499f72 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179266.146640:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179266.146768:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451101824 00000100:00100000:2.0:1788179266.146778:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451101824 00000100:00100000:2.0:1788179266.146836:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:2.0:1788179266.146884:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+13:14393:x1875041451101824:12345-192.168.202.2@tcp:101:bash.0 00010000:00010000:2.0:1788179266.146918:0:14276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179266.146938:0:14276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624600/0xaa4c98508c499f87 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662478 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.147017:0:14276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499f8e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.147032:0:14276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499f8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.147044:0:14276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499f8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179266.147080:0:14276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788179266.147084:0:14276:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788179266.147098:0:14276:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499f8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.147106:0:14276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499f8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.147125:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624600/0xaa4c98508c499f87 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662478 expref: 15 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.147147:0:14276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499f8e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662478 expref: 14 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.147171:0:14276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bc910f79300) 00010000:00010000:2.0:1788179266.147174:0:14276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788179266.147178:0:14276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc920625c00, rc 0) 00000100:00100000:2.0:1788179266.147233:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+14:14393:x1875041451101824:12345-192.168.202.2@tcp:101:bash.0 Request processed in 388us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179266.147238:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:2.0:1788179266.162823:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179266.163012:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451102080 00000100:00100000:1.0:1788179266.163024:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451102080 00000100:00100000:1.0:1788179266.163087:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:1.0:1788179266.163099:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90703b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+14:14393:x1875041451102080:12345-192.168.202.2@tcp:35:bash.0 00000100:00100000:1.0:1788179266.163454:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90703b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+15:14393:x1875041451102080:12345-192.168.202.2@tcp:35:bash.0 Request processed in 356us (641us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788179266.163461:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 5 00010000:00010000:1.0:1788179266.240231:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179266.257065:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179266.257940:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451102336 00000100:00100000:0.0:1788179266.257952:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451102336 00000100:00100000:0.0:1788179266.258116:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 30 00000100:00100000:0.0:1788179266.258127:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+15:14403:x1875041451102336:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:0.0:1788179266.258154:0:14275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179266.258178:0:14275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499f95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466247f expref: -99 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179266.258298:0:14275:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788179266.258440:0:14275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499f95 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466247f expref: 17 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.258454:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9bc910f79c00) 00010000:00010000:0.0:1788179266.258457:0:14275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788179266.258462:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499f95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466247f expref: 17 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.258488:0:14275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317f800, rc 0) 00000100:00100000:0.0:1788179266.258560:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+16:14403:x1875041451102336:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 435us (1506us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788179266.259310:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 30 00000100:00100000:2.0:1788179266.261812:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179266.262028:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451102592 00000100:00100000:1.0:1788179266.262038:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451102592 00000100:00100000:1.0:1788179266.262099:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:1.0:1788179266.262109:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+16:14403:x1875041451102592:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:1.0:1788179266.262383:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+17:14403:x1875041451102592:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 274us (582us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788179266.262392:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:1.0:1788179266.309620:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179266.310835:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451102848 00000100:00100000:2.0:1788179266.310860:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451102848 00000100:00100000:2.0:1788179266.311130:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:2.0:1788179266.311142:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+17:14406:x1875041451102848:12345-192.168.202.2@tcp:101:lfs.0 00010000:00010000:2.0:1788179266.311167:0:14276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179266.311190:0:14276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625200/0xaa4c98508c499fa3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662486 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.311291:0:14276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624400/0xaa4c98508c499faa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.311305:0:14276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624400/0xaa4c98508c499faa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.311316:0:14276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624400/0xaa4c98508c499faa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179266.311326:0:14276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788179266.311462:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625200/0xaa4c98508c499fa3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662486 expref: 20 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.311500:0:14276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624400/0xaa4c98508c499faa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662486 expref: 19 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.311510:0:14276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bc910f79300) 00010000:00010000:2.0:1788179266.311513:0:14276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788179266.311516:0:14276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc920624400, rc 0) 00000100:00100000:2.0:1788179266.312504:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+19:14406:x1875041451102848:12345-192.168.202.2@tcp:101:lfs.0 Request processed in 1361us (2891us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788179266.312515:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 31 00000100:00100000:3.0:1788179266.315022:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179266.315064:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179266.315867:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451102976 00000100:00100000:0.0:1788179266.315878:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451102976 00000100:00100000:0.0:1788179266.316368:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:0.0:1788179266.316381:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+19:2354:x1875041451102976:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179266.316401:0:14259:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179266.316531:0:14259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624400/0xaa4c98508c499faa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662486 expref: 19 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.316564:0:14259:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bc910f79300) 00010000:00010000:0.0:1788179266.316569:0:14259:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179266.316623:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+18:2354:x1875041451102976:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 246us (1611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179266.316631:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:1.0:1788179266.321508:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451103104 00000100:00100000:1.0:1788179266.321526:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451103104 00000100:00100000:1.0:1788179266.321625:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00100000:1.0:1788179266.321636:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+18:14406:x1875041451103104:12345-192.168.202.2@tcp:54:lfs.0 00010000:00010000:1.0:1788179266.323031:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cee00/0xaa4c98508c499fb8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179266.323072:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cee00/0xaa4c98508c499fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179266.323083:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cee00/0xaa4c98508c499fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179266.323114:0:14274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cee00/0xaa4c98508c499fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179266.323120:0:14274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cee00/0xaa4c98508c499fb8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179266.323126:0:14274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cee00/0xaa4c98508c499fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179266.323132:0:14274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92f7cee00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179266.323137:0:14274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cee00/0xaa4c98508c499fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179266.323144:0:14274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cee00/0xaa4c98508c499fb8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179266.323155:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bc910f79300) 00010000:00010000:1.0:1788179266.323158:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788179266.323162:0:14274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cee00/0xaa4c98508c499fb8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179266.323168:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cee00/0xaa4c98508c499fb8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179266.323307:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+18:14406:x1875041451103104:12345-192.168.202.2@tcp:54:lfs.0 Request processed in 1669us (8238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179266.323322:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 32 00000100:00100000:3.0:1788179266.340957:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179266.341052:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451103360 00000100:00100000:1.0:1788179266.341063:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451103360 00000100:00100000:1.0:1788179266.341119:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:1.0:1788179266.341129:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+18:14406:x1875041451103360:12345-192.168.202.2@tcp:35:lfs.0 00000100:00100000:1.0:1788179266.341371:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+19:14406:x1875041451103360:12345-192.168.202.2@tcp:35:lfs.0 Request processed in 243us (425us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788179266.341380:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:0.0:1788179266.642661:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179266.642778:0:16052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451103616 00000100:00100000:2.0:1788179266.642789:0:16052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451103616 00000100:00100000:2.0:1788179266.642871:0:16052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:2.0:1788179266.642894:0:16052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:baf94a59-5a83-4c54-8a75-155abe3189eb+19:14437:x1875041451103616:12345-192.168.202.2@tcp:101:cat.0 00010000:00010000:2.0:1788179266.642917:0:16052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179266.642937:0:16052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625200/0xaa4c98508c499fbf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466248d expref: -99 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.643038:0:16052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624400/0xaa4c98508c499fc6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.643049:0:16052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624400/0xaa4c98508c499fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.643058:0:16052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624400/0xaa4c98508c499fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179266.643067:0:16052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788179266.643227:0:16052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625200/0xaa4c98508c499fbf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466248d expref: 22 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.643248:0:16052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624400/0xaa4c98508c499fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466248d expref: 21 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.643256:0:16052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bc910f79300) 00010000:00010000:2.0:1788179266.643259:0:16052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788179266.643263:0:16052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc920624400, rc 0) 00000100:00100000:2.0:1788179266.643327:0:16052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:baf94a59-5a83-4c54-8a75-155abe3189eb+21:14437:x1875041451103616:12345-192.168.202.2@tcp:101:cat.0 Request processed in 446us (695us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788179266.643335:0:16052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 33 00000100:00100000:2.0:1788179266.648742:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179266.648822:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179266.648931:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451104000 00000100:00100000:3.0:1788179266.648944:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451104000 00000100:00100000:1.0:1788179266.649007:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451103872 00000100:00100000:1.0:1788179266.649012:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451103872 00000100:00100000:1.0:1788179266.649066:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:1.0:1788179266.649077:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90703bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+22:14437:x1875041451103872:12345-192.168.202.2@tcp:35:cat.0 00000100:00100000:1.0:1788179266.649453:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90703bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+23:14437:x1875041451103872:12345-192.168.202.2@tcp:35:cat.0 Request processed in 376us (718us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788179266.649461:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 8 00000100:00100000:3.0:1788179266.649673:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:3.0:1788179266.649681:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90703b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+22:2356:x1875041451104000:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788179266.649710:0:14258:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179266.649734:0:14258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624400/0xaa4c98508c499fc6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466248d expref: 22 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179266.649753:0:14258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bc910f79300) 00010000:00010000:3.0:1788179266.649758:0:14258:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179266.649787:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90703b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+21:2356:x1875041451104000:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 108us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179266.649794:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:2.0:1788179266.698401:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179266.698453:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179266.698477:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179266.698800:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451104128 00000100:00100000:0.0:1788179266.698812:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451104128 00000100:00100000:2.0:1788179266.699632:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179266.699713:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 120 00000100:00100000:0.0:1788179266.699726:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+13:2356:x1875041451104128:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179266.699801:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+13:2356:x1875041451104128:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 78us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179266.699809:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 120 00000100:00100000:3.0:1788179266.700095:0:14907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451104384 00000100:00100000:3.0:1788179266.700102:0:14907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451104384 00000100:00100000:3.0:1788179266.700147:0:14907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451104640 00000100:00100000:3.0:1788179266.700151:0:14907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451104640 00000100:00100000:3.0:1788179266.700169:0:14907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:3.0:1788179266.700176:0:14907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+5:2356:x1875041451104384:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788179266.700214:0:14907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+5:2356:x1875041451104384:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 38us (1760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179266.700220:0:14907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:3.0:1788179266.700233:0:14907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:3.0:1788179266.700240:0:14907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:173e045c-d692-4828-8fa4-7aaba778738a+5:2356:x1875041451104640:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788179266.700265:0:14907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:173e045c-d692-4828-8fa4-7aaba778738a+5:2356:x1875041451104640:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 26us (1787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179266.700271:0:14907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:2.0:1788179266.700384:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179266.700637:0:14908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451104256 00000100:00100000:1.0:1788179266.700642:0:14908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451104256 00000100:00100000:1.0:1788179266.700673:0:14908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451104512 00000100:00100000:1.0:1788179266.700676:0:14908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451104512 00000100:00100000:1.0:1788179266.700694:0:14908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:1.0:1788179266.700700:0:14908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+5:2356:x1875041451104256:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179266.700744:0:14908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+5:2356:x1875041451104256:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 44us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179266.700750:0:14908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:1.0:1788179266.700763:0:14908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:1.0:1788179266.700780:0:14908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173e045c-d692-4828-8fa4-7aaba778738a+5:2356:x1875041451104512:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:1.0:1788179266.700806:0:14908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173e045c-d692-4828-8fa4-7aaba778738a+5:2356:x1875041451104512:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 27us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179266.700812:0:14908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00080000:0.0:1788179266.701470:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788179266.701801:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788179266.720749:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179266.721186:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451104896 00000100:00100000:0.0:1788179266.721657:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451104896 00000100:00100000:0.0:1788179266.721740:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:0.0:1788179266.721750:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+21:14443:x1875041451104896:12345-192.168.202.2@tcp:101:dd.0 00010000:00010000:0.0:1788179266.721775:0:14276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179266.721798:0:14276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499fd4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c42474662494 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.721933:0:14276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499fdb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.721948:0:14276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c499f79 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662471 expref: 22 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.721968:0:14276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499f8e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662478 expref: 22 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.721978:0:14276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499fdb lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.722129:0:14276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499f8e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662478 expref: 22 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.722144:0:14276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499f8e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662478 expref: 22 pid: 14276 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179266.722161:0:14276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93a82df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14276:1875041472063104:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788179266.722443:0:14276:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c499f79 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662471 expref: 22 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.722465:0:14276:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c499f79 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662471 expref: 22 pid: 16052 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179266.722475:0:14276:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93a82e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14276:1875041472063232:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788179266.723498:0:14276:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc90f735a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788179266.728839:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179266.728898:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179266.728988:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451105024 00000100:00100000:3.0:1788179266.728997:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451105024 00010000:00010000:3.0:1788179266.729037:0:14258:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499f8e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662478 expref: 23 pid: 14276 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179266.729086:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451105152 00000100:00100000:3.0:1788179266.729089:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451105152 00010000:00010000:3.0:1788179266.729100:0:14258:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c499f79 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662471 expref: 24 pid: 16052 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179266.729114:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:3.0:1788179266.729121:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f8ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+24:2357:x1875041451105024:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788179266.729139:0:14258:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179266.729146:0:14258:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499f8e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662478 expref: 24 pid: 14276 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179266.729158:0:14258:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499f8e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662478 expref: 24 pid: 14276 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179266.729190:0:14258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bc910f79300) 00010000:00010000:3.0:1788179266.729195:0:14258:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499fdb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179266.729203:0:14258:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499fdb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179266.729210:0:14258:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179266.729258:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f8ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+24:2357:x1875041451105024:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 135us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179266.729266:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:3.0:1788179266.729322:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:3.0:1788179266.729328:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+23:2357:x1875041451105152:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788179266.729341:0:14258:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179266.729346:0:14258:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c499f79 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662471 expref: 23 pid: 16052 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179266.729355:0:14258:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c499f79 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662471 expref: 23 pid: 16052 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179266.729367:0:14258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bc910f79300) 00010000:00010000:3.0:1788179266.729371:0:14258:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499fdb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179266.729379:0:14258:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499fdb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179266.729386:0:14258:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499fdb lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179266.729400:0:14258:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179266.729415:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+23:2357:x1875041451105152:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 88us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179266.729421:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00010000:00010000:0.0:1788179266.730775:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c499f8e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662478 expref: 22 pid: 14276 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179266.730804:0:14276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93a82df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14276:1875041472063104:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788179266.730817:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c499f79 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.2@tcp remote: 0x34c7c42474662471 expref: 21 pid: 16052 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179266.730826:0:14276:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93a82e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14276:1875041472063232:192.168.202.2@tcp:104: 00010000:00010000:0.0:1788179266.730930:0:14276:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499fdb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.730941:0:14276:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499fdb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.730947:0:14276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499fdb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179266.730975:0:14276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788179266.731802:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c499fd4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662494 expref: 22 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.731844:0:14276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f200/0xaa4c98508c499fdb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c42474662494 expref: 21 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.731893:0:14276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bc910f79300) 00010000:00010000:0.0:1788179266.731896:0:14276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788179266.731899:0:14276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317f200, rc 0) 00000100:00100000:0.0:1788179266.731960:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+21:14443:x1875041451104896:12345-192.168.202.2@tcp:101:dd.0 Request processed in 10211us (11220us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788179266.731969:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 34 00000100:00100000:2.0:1788179266.735803:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179266.735939:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451105408 00000100:00100000:3.0:1788179266.735950:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451105408 00000100:00100000:3.0:1788179266.736011:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 35 00000100:00100000:3.0:1788179266.736021:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+21:14443:x1875041451105408:12345-192.168.202.2@tcp:36:dd.0 00010000:00010000:3.0:1788179266.736406:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499fe9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179266.736424:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499fe9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179266.736449:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499fe9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788179266.736783:0:14274:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1788179266.736814:0:14274:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000138eac25 reply state 00000000c05997ce transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499fe9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179266.736824:0:14274:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788179266.737532:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+24:14443:x1875041451105408:12345-192.168.202.2@tcp:36:dd.0 Request processed in 1508us (1735us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1788179266.737541:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 35 00000020:00080000:3.0:1788179266.737547:0:14274:0:(tgt_main.c:811:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788179266.743125:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00010000:00010000:1.0:1788179266.744251:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499fe9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179266.744265:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499fe9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179266.744274:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499fe9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179266.744280:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5200 already unused, calling callback (ffffffffc20864f0) 00000100:00100000:3.0:1788179266.744368:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451105536 00000100:00100000:3.0:1788179266.744380:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451105536 00010000:00010000:1.0:1788179266.744459:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499fe9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179266.744471:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499fe9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179266.744498:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bc910f79300) 00010000:00010000:1.0:1788179266.744501:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179266.744505:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499fe9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179266.744512:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c499fe9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179266.744708:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 36 00000100:00100000:3.0:1788179266.744719:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+23:14443:x1875041451105536:12345-192.168.202.2@tcp:101:dd.0 00010000:00010000:3.0:1788179266.744741:0:14275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179266.744758:0:14275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499ff0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c4247466249b expref: -99 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179266.744817:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499ff0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466249b expref: 24 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179266.744830:0:14275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499ff0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466249b expref: 24 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179266.744846:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bc910f79300) 00010000:00010000:3.0:1788179266.744874:0:14275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788179266.744890:0:14275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b5e00, rc 0) 00000100:00100000:3.0:1788179266.744968:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+24:14443:x1875041451105536:12345-192.168.202.2@tcp:101:dd.0 Request processed in 250us (1852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179266.744976:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 36 00000040:00080000:0.0:1788179266.754678:0:14308:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788179266.762694:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179266.762781:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451105792 00000100:00100000:3.0:1788179266.762790:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451105792 00000100:00100000:3.0:1788179266.763083:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:3.0:1788179266.763093:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+24:14443:x1875041451105792:12345-192.168.202.2@tcp:103:dd.0 00010000:00010000:3.0:1788179266.763107:0:14258:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179266.763132:0:14258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c499ff0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c4247466249b expref: 24 pid: 14275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179266.763152:0:14258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bc910f79300) 00010000:00010000:3.0:1788179266.763157:0:14258:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179266.763251:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+23:14443:x1875041451105792:12345-192.168.202.2@tcp:103:dd.0 Request processed in 160us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179266.763258:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:2.0:1788179266.765061:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179266.765129:0:16052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451105920 00000100:00100000:0.0:1788179266.765137:0:16052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451105920 00000100:00100000:0.0:1788179266.765348:0:16052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 37 00000100:00100000:0.0:1788179266.765357:0:16052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:baf94a59-5a83-4c54-8a75-155abe3189eb+23:14443:x1875041451105920:12345-192.168.202.2@tcp:58:dd.0 00010000:00010000:0.0:1788179266.765446:0:16052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499ff7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.765464:0:16052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499ff7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179266.765476:0:16052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499ff7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788179266.766760:0:16052:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788179266.766924:0:16052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788179266.766972:0:16052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788179266.767139:0:16052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:baf94a59-5a83-4c54-8a75-155abe3189eb+23:14443:x1875041451105920:12345-192.168.202.2@tcp:58:dd.0 Request processed in 1778us (2078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179266.767150:0:16052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 37 00000100:00100000:0.0:1788179266.771231:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179266.771393:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451106048 00000100:00100000:2.0:1788179266.771401:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451106048 00000100:00100000:2.0:1788179266.771486:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 38 00000100:00100000:2.0:1788179266.771510:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+23:14443:x1875041451106048:12345-192.168.202.2@tcp:101:dd.0 00010000:00010000:2.0:1788179266.771531:0:14276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179266.771554:0:14276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625600/0xaa4c98508c499ffe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746624a2 expref: -99 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.771618:0:14276:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499ff7 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.771626:0:14276:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625600/0xaa4c98508c499ffe lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624a2 expref: 24 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.771639:0:14276:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499ff7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.771660:0:14276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625600/0xaa4c98508c499ffe lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624a2 expref: 24 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.771675:0:14276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bc910f79300) 00010000:00010000:2.0:1788179266.771682:0:14276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788179266.771686:0:14276:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625600/0xaa4c98508c499ffe lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624a2 expref: 24 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179266.771694:0:14276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc920625600, rc 0) 00000100:00100000:2.0:1788179266.771763:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+24:14443:x1875041451106048:12345-192.168.202.2@tcp:101:dd.0 Request processed in 255us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179266.771770:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 38 00010000:00010000:0.0:1788179267.264085:0:15878:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788179267.776138:0:14308:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788179267.776150:0:14308:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788179267.776206:0:14308:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788179267.776216:0:14308:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788179267.776342:0:14308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93a82dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14308:1875041472063360:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788179267.776740:0:14308:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc90f7350c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788179267.779599:0:14308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93a82dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14308:1875041472063360:192.168.202.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788179267.783945:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179267.784175:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451106176 00000100:00100000:2.0:1788179267.784186:0:14285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451106176 00000100:00100000:2.0:1788179267.784270:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:2.0:1788179267.784280:0:14285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:baf94a59-5a83-4c54-8a75-155abe3189eb+24:14444:x1875041451106176:12345-192.168.202.2@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788179267.784371:0:14285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:baf94a59-5a83-4c54-8a75-155abe3189eb+24:14444:x1875041451106176:12345-192.168.202.2@tcp:900:lhsmtool_posix.0 Request processed in 93us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179267.784379:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00080000:0.0:1788179267.784831:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788179267.792222:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179267.792575:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451106304 00000100:00100000:3.0:1788179267.792586:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451106304 00000100:00100000:3.0:1788179267.792770:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:3.0:1788179267.792781:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+24:14444:x1875041451106304:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788179267.792815:0:14274:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788179267.793033:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+24:14444:x1875041451106304:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 253us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179267.793042:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 39 00000100:00100000:1.0:1788179267.798817:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179267.798911:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451106432 00000100:00100000:2.0:1788179267.798937:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451106432 00000100:00100000:2.0:1788179267.798996:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00100000:2.0:1788179267.799008:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc803603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+24:14444:x1875041451106432:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788179267.799084:0:14276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c49a005 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799102:0:14276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c49a005 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799114:0:14276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c49a005 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799172:0:14276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c49a00c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799180:0:14276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c49a00c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799187:0:14276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c49a00c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799211:0:14276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c49a013 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799240:0:14276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c49a013 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799248:0:14276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c49a013 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788179267.799297:0:14276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788179267.799303:0:14276:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788179267.799322:0:14276:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c49a013 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799333:0:14276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c49a005 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799340:0:14276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c49a005 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799347:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c49a005 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799353:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920624000 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179267.799358:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c49a005 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799367:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c49a005 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799378:0:14276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bc9062cba00) 00010000:00010000:2.0:1788179267.799381:0:14276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179267.799397:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c49a005 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799415:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624000/0xaa4c98508c49a005 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799442:0:14276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c49a00c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799449:0:14276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c49a00c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799454:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c49a00c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799460:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920625c00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179267.799463:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c49a00c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799469:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c49a00c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799478:0:14276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9bc910f79800) 00010000:00010000:2.0:1788179267.799481:0:14276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179267.799484:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c49a00c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799489:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c49a00c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799514:0:14276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c49a013 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799520:0:14276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c49a013 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799533:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c49a013 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799538:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920624c00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:2.0:1788179267.799541:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c49a013 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799546:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c49a013 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799553:0:14276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bc910f79300) 00010000:00010000:2.0:1788179267.799555:0:14276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788179267.799558:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c49a013 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.799564:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c49a013 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179267.799661:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc803603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+24:14444:x1875041451106432:12345-192.168.202.2@tcp:34:lhsmtool_posix.0 Request processed in 655us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179267.799670:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 40 00000100:00100000:1.0:1788179267.816951:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179267.817299:0:16052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451106688 00000100:00100000:0.0:1788179267.817310:0:16052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451106688 00000100:00100000:0.0:1788179267.817381:0:16052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 41 00000100:00100000:0.0:1788179267.817403:0:16052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:baf94a59-5a83-4c54-8a75-155abe3189eb+24:14444:x1875041451106688:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788179267.817425:0:16052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788179267.817698:0:16052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e800/0xaa4c98508c49a01a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746624a9 expref: -99 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179267.817804:0:16052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c49a021 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179267.817819:0:16052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c49a021 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179267.817832:0:16052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c49a021 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788179267.820902:0:16052:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788179267.821144:0:16052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c49a021 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179267.821154:0:16052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c49a021 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179267.821162:0:16052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c49a021 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179267.821168:0:16052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317fa00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179267.821172:0:16052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c49a021 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179267.821179:0:16052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c49a021 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179267.821197:0:16052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bc910f79300) 00010000:00010000:1.0:1788179267.821200:0:16052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788179267.821217:0:16052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c49a021 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179267.821223:0:16052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317fa00/0xaa4c98508c49a021 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179267.821284:0:16052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e800/0xaa4c98508c49a01a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624a9 expref: 26 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179267.821296:0:16052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9bc9062cba00) 00010000:00010000:1.0:1788179267.821299:0:16052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788179267.821303:0:16052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317e800/0xaa4c98508c49a01a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624a9 expref: 26 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179267.821331:0:16052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc91317e800, rc 0) 00000100:00100000:1.0:1788179267.821410:0:16052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:baf94a59-5a83-4c54-8a75-155abe3189eb+25:14444:x1875041451106688:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 4019us (4470us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1788179267.821420:0:16052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 41 00000100:00100000:0.0:1788179267.834789:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179267.835082:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451106816 00000100:00100000:3.0:1788179267.835093:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451106816 00000100:00100000:3.0:1788179267.835155:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:3.0:1788179267.835166:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93a82ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+25:14444:x1875041451106816:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788179267.835216:0:14275:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788179267.835406:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93a82ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+25:14444:x1875041451106816:12345-192.168.202.2@tcp:53:lhsmtool_posix.0 Request processed in 241us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179267.835416:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 42 00000100:00100000:0.0:1788179267.849842:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179267.850683:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451107072 00000100:00100000:3.0:1788179267.850694:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451107072 00000100:00100000:3.0:1788179267.850802:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:3.0:1788179267.850823:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc935a23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+25:14444:x1875041451107072:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788179267.850845:0:14274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179267.850908:0:14274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c49a02f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746624b0 expref: -99 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788179267.851704:0:14274:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:3.0:1788179267.851711:0:14274:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:3.0:1788179267.851759:0:14274:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1788179267.852069:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49a036 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.852084:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49a036 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.852096:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49a036 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.852155:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5e00/0xaa4c98508c49a02f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624b0 expref: 28 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.852184:0:14274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49a036 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624b0 expref: 27 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.852193:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bc903312d00) 00010000:00010000:3.0:1788179267.852196:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788179267.852199:0:14274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b4c00, rc 0) 00000100:00100000:3.0:1788179267.852266:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc935a23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+27:14444:x1875041451107072:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 1455us (2434us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1788179267.852274:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 43 00000100:00100000:2.0:1788179267.861601:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179267.862814:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451107328 00000100:00100000:3.0:1788179267.862827:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451107328 00000100:00100000:3.0:1788179267.862918:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:3.0:1788179267.862930:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+27:14444:x1875041451107328:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788179267.863106:0:14275:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179267.863134:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4c00/0xaa4c98508c49a036 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624b0 expref: 27 pid: 14274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.863154:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bc903312d00) 00010000:00010000:3.0:1788179267.863164:0:14275:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788179267.863188:0:14275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c49a044 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.863202:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c49a044 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.863212:0:14275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c49a044 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.863241:0:14275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c49a04b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x34b72535 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.863249:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c49a04b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x34b72535 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.863255:0:14275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c49a04b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x34b72535 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.863328:0:14275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c49a044 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.863336:0:14275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c49a044 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.863343:0:14275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c49a044 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.863349:0:14275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4800 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179267.863352:0:14275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c49a044 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.863360:0:14275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c49a044 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.863369:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9bc910f79700) 00010000:00010000:3.0:1788179267.863372:0:14275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179267.863376:0:14275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c49a044 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.864761:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b4800/0xaa4c98508c49a044 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.864792:0:14275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c49a04b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x34b72535 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.864799:0:14275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c49a04b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x34b72535 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.864806:0:14275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c49a04b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x34b72535 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.864813:0:14275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b5200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179267.864817:0:14275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c49a04b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x34b72535 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.864824:0:14275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c49a04b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x34b72535 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.864834:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x34b72535 (ffff9bc903312a00) 00010000:00010000:3.0:1788179267.864837:0:14275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788179267.864840:0:14275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c49a04b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x34b72535 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.864846:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc9137b5200/0xaa4c98508c49a04b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x34b72535 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179267.865679:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+26:14444:x1875041451107328:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 2742us (4079us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788179267.865691:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 44 00000100:00100000:0.0:1788179267.876563:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179267.876676:0:16052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451107456 00000100:00100000:1.0:1788179267.876688:0:16052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451107456 00000100:00100000:1.0:1788179267.876752:0:16052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00100000:1.0:1788179267.876763:0:16052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:baf94a59-5a83-4c54-8a75-155abe3189eb+26:14444:x1875041451107456:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788179267.876789:0:16052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179267.876820:0:16052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c49a052 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746624b7 expref: -99 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179267.876904:0:16052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cf800/0xaa4c98508c49a059 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179267.876918:0:16052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cf800/0xaa4c98508c49a059 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179267.876929:0:16052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cf800/0xaa4c98508c49a059 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179267.877042:0:16052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c49a052 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624b7 expref: 28 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179267.877062:0:16052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cf800/0xaa4c98508c49a059 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624b7 expref: 27 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179267.877083:0:16052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bc920ca7e00) 00010000:00010000:1.0:1788179267.877086:0:16052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788179267.877090:0:16052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc92f7cf800, rc 0) 00000100:00100000:1.0:1788179267.877157:0:16052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:baf94a59-5a83-4c54-8a75-155abe3189eb+27:14444:x1875041451107456:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 395us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179267.877164:0:16052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 45 00000100:00100000:0.0:1788179267.881007:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179267.881075:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451107712 00000100:00100000:2.0:1788179267.881085:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451107712 00000100:00100000:2.0:1788179267.881147:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:2.0:1788179267.881157:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+27:14444:x1875041451107712:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788179267.881258:0:14276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c49a060 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.881275:0:14276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c49a060 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179267.881287:0:14276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c49a060 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788179267.882212:0:14276:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1788179267.882225:0:14276:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 463945375384ns, next at 464945373257ns, rc = 0 00000004:00010000:2.0:1788179267.882323:0:14276:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007f48d2bf reply state 00000000aca60e5d transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c49a060 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179267.882333:0:14276:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788179267.884746:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+29:14444:x1875041451107712:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 3579us (3738us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788179267.884759:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 46 00000100:00100000:2.0:1788179267.893991:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179267.897009:0:16052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451107840 00000100:00100000:1.0:1788179267.897026:0:16052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451107840 00000100:00100000:1.0:1788179267.897107:0:16052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 47 00000100:00100000:1.0:1788179267.897117:0:16052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:baf94a59-5a83-4c54-8a75-155abe3189eb+29:14444:x1875041451107840:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788179267.897139:0:16052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179267.897160:0:16052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c49a067 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746624be expref: -99 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179267.897226:0:16052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c49a067 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624be expref: 30 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179267.897242:0:16052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c49a067 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624be expref: 30 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179267.897262:0:16052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bc920ca7e00) 00010000:00010000:1.0:1788179267.897265:0:16052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788179267.897269:0:16052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc92f7cfe00, rc 0) 00000100:00100000:1.0:1788179267.897350:0:16052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:baf94a59-5a83-4c54-8a75-155abe3189eb+30:14444:x1875041451107840:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 234us (3378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179267.897373:0:16052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 47 00010000:00010000:3.0:1788179267.902790:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c49a060 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.902810:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c49a060 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.902818:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c49a060 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.902837:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920625c00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:3.0:1788179267.902842:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c49a060 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.902881:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c49a060 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.902901:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bc920ca7e00) 00010000:00010000:3.0:1788179267.902903:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788179267.902907:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c49a060 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.902913:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625c00/0xaa4c98508c49a060 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14276 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179267.903997:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179267.904148:0:14908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451107968 00000100:00100000:1.0:1788179267.904160:0:14908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451107968 00000100:00100000:1.0:1788179267.904216:0:14908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:1.0:1788179267.904227:0:14908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+5:2357:x1875041451107968:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788179267.904611:0:14908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+6:2357:x1875041451107968:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 385us (620us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788179267.904619:0:14908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 12 00000100:00100000:2.0:1788179267.922838:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179267.923493:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451108224 00000100:00100000:0.0:1788179267.923516:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451108224 00000100:00100000:0.0:1788179267.923627:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:0.0:1788179267.923647:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+29:14444:x1875041451108224:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788179267.923971:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+30:14444:x1875041451108224:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 333us (1143us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1788179267.923980:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 9 00000100:00100000:2.0:1788179267.929531:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179267.929651:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451108480 00000100:00100000:0.0:1788179267.929662:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451108480 00000100:00100000:0.0:1788179267.929728:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:0.0:1788179267.929741:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+30:14444:x1875041451108480:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788179267.929911:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+30:14444:x1875041451108480:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 173us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179267.929918:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 48 00000100:00100000:2.0:1788179267.934288:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179267.934433:0:16052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451108608 00000100:00100000:1.0:1788179267.934443:0:16052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451108608 00000100:00100000:1.0:1788179267.934499:0:16052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:1.0:1788179267.934508:0:16052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:baf94a59-5a83-4c54-8a75-155abe3189eb+30:14444:x1875041451108608:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788179267.934528:0:16052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788179267.934556:0:16052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cf400/0xaa4c98508c49a06e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746624c5 expref: -99 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179267.934629:0:16052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7ce200/0xaa4c98508c49a075 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179267.934653:0:16052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7ce200/0xaa4c98508c49a075 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179267.934665:0:16052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7ce200/0xaa4c98508c49a075 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788179267.934702:0:16052:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788179267.934717:0:16052:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7ce200/0xaa4c98508c49a075 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179267.934756:0:16052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cf400/0xaa4c98508c49a06e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624c5 expref: 32 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179267.934774:0:16052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7ce200/0xaa4c98508c49a075 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624c5 expref: 31 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179267.934782:0:16052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bc920ca7e00) 00010000:00010000:1.0:1788179267.934785:0:16052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788179267.934788:0:16052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc92f7ce200, rc 0) 00000100:00100000:1.0:1788179267.934898:0:16052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:baf94a59-5a83-4c54-8a75-155abe3189eb+31:14444:x1875041451108608:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 342us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179267.934905:0:16052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 49 00000100:00100000:1.0:1788179267.944839:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179267.945243:0:14907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451108736 00000100:00100000:3.0:1788179267.945254:0:14907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451108736 00000100:00100000:3.0:1788179267.945318:0:14907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:3.0:1788179267.945327:0:14907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+6:2357:x1875041451108736:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788179267.945346:0:14907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788179267.945371:0:14907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000033dccf/0xaa4c98508c49a07c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746624cc expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788179267.945399:0:14907:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a957343, blocks: 0x1 00010000:00010000:3.0:1788179267.945418:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=464s v=(0 0) 00010000:00010000:3.0:1788179267.945424:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788179267.945432:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000033dccf/0xaa4c98508c49a07c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624cc expref: 7 pid: 14907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.945474:0:14907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000033dccf/0xaa4c98508c49a07c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624cc expref: 7 pid: 14907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179267.945488:0:14907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc9137b5200, rc 0) 00000100:00100000:3.0:1788179267.945560:0:14907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+7:2357:x1875041451108736:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 233us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179267.945568:0:14907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:2.0:1788179267.959406:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179267.959510:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451108992 00000100:00100000:0.0:1788179267.959520:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451108992 00000100:00100000:0.0:1788179267.959584:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 50 00000100:00100000:0.0:1788179267.959595:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+31:14444:x1875041451108992:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788179267.959726:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+31:14444:x1875041451108992:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 132us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179267.959748:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 50 00000100:00100000:2.0:1788179267.963986:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179267.964225:0:16052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451109120 00000100:00100000:1.0:1788179267.964236:0:16052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451109120 00000100:00100000:1.0:1788179267.964298:0:16052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:1.0:1788179267.964309:0:16052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:baf94a59-5a83-4c54-8a75-155abe3189eb+31:14444:x1875041451109120:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788179268.034152:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:3.0:1788179268.034181:0:5818:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000004:00080000:3.0:1788179268.034211:0:5818:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788179268.034394:0:16052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:baf94a59-5a83-4c54-8a75-155abe3189eb+20:14444:x1875041451109120:12345-192.168.202.2@tcp:44:lhsmtool_posix.0 Request processed in 70081us (70422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179268.034405:0:16052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 51 00000100:00100000:1.0:1788179268.040465:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788179268.040492:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc9359bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472063488:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788179268.040692:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179268.040882:0:14910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472063488 00000100:00100000:2.0:1788179268.040891:0:14910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472063488 00000100:00100000:2.0:1788179268.041268:0:14910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788179268.041278:0:14910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472063488:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788179268.041464:0:14910:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788179268.041480:0:14910:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788179268.041483:0:14910:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788179268.041485:0:14910:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788179267 -> 1788179267 00002000:00010000:2.0:1788179268.041487:0:14910:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788179268.041541:0:14910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1875041472063488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 265us (849us total) trans 8589934595 rc 0/0 00000100:00080000:0.0:1788179268.041715:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788179268.041754:0:14910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788179268.042149:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179268.043225:0:14907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451109248 00000100:00100000:1.0:1788179268.043238:0:14907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451109248 00000100:00100000:1.0:1788179268.043298:0:14907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:1.0:1788179268.043318:0:14907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+7:2357:x1875041451109248:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788179268.043416:0:14907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+7:2357:x1875041451109248:12345-192.168.202.2@tcp:16:lhsmtool_posix.0 Request processed in 99us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179268.043423:0:14907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00080000:3.0:1788179268.043578:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788179268.043794:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9bc9359bb800/2, rc 0, transno 8589934595 00000100:00100000:2.0:1788179268.043802:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc9359bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472063488:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788179268.046416:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179268.046718:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451109504 00000100:00100000:2.0:1788179268.046728:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451109504 00000100:00100000:2.0:1788179268.046792:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 52 00000100:00100000:2.0:1788179268.046802:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e8d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+14:14444:x1875041451109504:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788179268.046887:0:14275:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788179268.046916:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7ce200/0xaa4c98508c49a075 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624c5 expref: 14 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.046936:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bc920ca7e00) 00010000:00010000:2.0:1788179268.046940:0:14275:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788179268.046990:0:14275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624600/0xaa4c98508c49a083 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.047003:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624600/0xaa4c98508c49a083 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.047012:0:14275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624600/0xaa4c98508c49a083 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788179268.047213:0:14275:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000411cb680 reply state 0000000017f7022d transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624600/0xaa4c98508c49a083 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179268.047237:0:14275:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788179268.047332:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e8d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+15:14444:x1875041451109504:12345-192.168.202.2@tcp:36:lhsmtool_posix.0 Request processed in 531us (926us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788179268.047340:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 52 00000100:00100000:2.0:1788179268.051829:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179268.051934:0:14907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451109632 00000100:00100000:2.0:1788179268.051955:0:14907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451109632 00000100:00100000:2.0:1788179268.052021:0:14907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:2.0:1788179268.052032:0:14907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9359bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+7:14444:x1875041451109632:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788179268.052053:0:14907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788179268.052076:0:14907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c49a08a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34c7c424746624d3 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.052110:0:14907:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000033dccf/0xaa4c98508c49a07c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624cc expref: 8 pid: 14907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.052119:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179268.052124:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179268.052129:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c49a08a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624d3 expref: 8 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.052165:0:14907:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000033dccf/0xaa4c98508c49a07c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746624cc expref: 8 pid: 14907 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.052180:0:14907:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000033dccf/0xaa4c98508c49a07c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746624cc expref: 8 pid: 14907 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179268.052208:0:14907:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b6a5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14907:1875041472063616:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788179268.052288:0:14907:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e49d180 going to sleep for 11 seconds 00010000:00010000:1.0:1788179268.052408:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624600/0xaa4c98508c49a083 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.052417:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624600/0xaa4c98508c49a083 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.052424:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624600/0xaa4c98508c49a083 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.052442:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920624600 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179268.052447:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624600/0xaa4c98508c49a083 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.052454:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624600/0xaa4c98508c49a083 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.052470:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bc920ca7e00) 00010000:00010000:1.0:1788179268.052473:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179268.052477:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624600/0xaa4c98508c49a083 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.052482:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624600/0xaa4c98508c49a083 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179268.058353:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179268.059366:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451109760 00000100:00100000:0.0:1788179268.059380:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451109760 00010000:00010000:0.0:1788179268.059449:0:14260:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000033dccf/0xaa4c98508c49a07c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746624cc expref: 9 pid: 14907 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179268.059498:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:0.0:1788179268.059509:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+9:2356:x1875041451109760:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788179268.059524:0:14260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788179268.059559:0:14260:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000033dccf/0xaa4c98508c49a07c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746624cc expref: 9 pid: 14907 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179268.059574:0:14260:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000033dccf/0xaa4c98508c49a07c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746624cc expref: 9 pid: 14907 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179268.059600:0:14260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788179268.059606:0:14260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788179268.059614:0:14260:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c49a08a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624d3 expref: 9 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179268.059624:0:14260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c49a08a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624d3 expref: 9 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179268.059673:0:14260:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c49a08a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624d3 expref: 9 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179268.059703:0:14260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0f4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14260:1875041472063744:192.168.202.2@tcp:105: 00000100:00100000:0.0:1788179268.059888:0:14260:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9266da000 going to sleep for 11 seconds 00010000:00010000:2.0:1788179268.060398:0:14907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000033dccf/0xaa4c98508c49a07c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746624cc expref: 9 pid: 14907 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179268.060414:0:14907:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b6a5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14907:1875041472063616:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788179268.061634:0:14907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c49a08a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624d3 expref: 8 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.061667:0:14907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9bc920625c00, rc 0) 00000100:00100000:2.0:1788179268.061727:0:14907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9359bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+8:14444:x1875041451109632:12345-192.168.202.2@tcp:101:lhsmtool_posix.0 Request processed in 9697us (9908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179268.061737:0:14907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 16 00000100:00100000:2.0:1788179268.068632:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179268.068792:0:14908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451109888 00000100:00100000:1.0:1788179268.068815:0:14908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451109888 00000100:00100000:1.0:1788179268.068898:0:14908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:1.0:1788179268.068908:0:14908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+8:2356:x1875041451109888:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788179268.069127:0:14908:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788179268.069131:0:14908:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788179266 00002000:00010000:1.0:1788179268.069134:0:14908:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788179265 00002000:00010000:1.0:1788179268.069137:0:14908:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788179267 -> 1788179266 00002000:00010000:1.0:1788179268.069139:0:14908:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788179268.069196:0:14908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+9:2356:x1875041451109888:12345-192.168.202.2@tcp:2:lhsmtool_posix.0 Request processed in 289us (574us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788179268.069204:0:14908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 17 00000100:00100000:0.0:1788179268.070005:0:14260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0f4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14260:1875041472063744:192.168.202.2@tcp:105: 00010000:00010000:0.0:1788179268.070028:0:14260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788179268.070069:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+8:2356:x1875041451109760:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 10562us (11726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179268.070079:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 13 00000100:00100000:0.0:1788179268.075328:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179268.075498:0:14907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451110016 00000100:00100000:2.0:1788179268.075508:0:14907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451110016 00000100:00100000:2.0:1788179268.075672:0:14907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:2.0:1788179268.075683:0:14907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+8:2357:x1875041451110016:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788179268.075734:0:14907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c49a091 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.075757:0:14907:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c49a08a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624d3 expref: 8 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.075787:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179268.075791:0:14907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788179268.075796:0:14907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c49a091 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.075831:0:14907:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c49a08a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.2@tcp remote: 0x34c7c424746624d3 expref: 8 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.075846:0:14907:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c49a08a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c424746624d3 expref: 8 pid: 14907 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179268.075895:0:14907:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b6a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14907:1875041472063872:192.168.202.2@tcp:104: 00000100:00100000:2.0:1788179268.075999:0:14907:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc92e49d180 going to sleep for 11 seconds 00000100:00100000:0.0:1788179268.084603:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179268.084907:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451110144 00000100:00100000:3.0:1788179268.084918:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451110144 00010000:00010000:3.0:1788179268.084974:0:14258:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c49a08a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c424746624d3 expref: 9 pid: 14907 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179268.085021:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 14 00000100:00100000:3.0:1788179268.085032:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+9:2356:x1875041451110144:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788179268.085048:0:14258:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788179268.085085:0:14258:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c49a08a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c424746624d3 expref: 9 pid: 14907 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179268.085101:0:14258:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c49a08a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.2@tcp remote: 0x34c7c424746624d3 expref: 9 pid: 14907 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179268.085142:0:14258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788179268.085147:0:14258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788179268.085153:0:14258:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c49a091 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179268.085163:0:14258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c49a091 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179268.085184:0:14258:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788179268.085243:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+9:2356:x1875041451110144:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 214us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179268.085251:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 14 00010000:00010000:2.0:1788179268.085707:0:14907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c49a08a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.2@tcp remote: 0x34c7c424746624d3 expref: 8 pid: 14907 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179268.085723:0:14907:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b6a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14907:1875041472063872:192.168.202.2@tcp:104: 00010000:00010000:2.0:1788179268.085747:0:14907:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c49a091 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.085757:0:14907:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c49a091 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.085764:0:14907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c49a091 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.085798:0:14907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c49a091 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.085807:0:14907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c49a091 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.085815:0:14907:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c49a091 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.085822:0:14907:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920624c00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:2.0:1788179268.085827:0:14907:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c49a091 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.085835:0:14907:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c49a091 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.085905:0:14907:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c49a091 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.085914:0:14907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c49a091 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788179268.085979:0:14907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+7:2357:x1875041451110016:12345-192.168.202.2@tcp:1:lhsmtool_posix.0 Request processed in 10286us (10649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179268.086000:0:14907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 18 00000100:00100000:3.0:1788179268.095370:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179268.095576:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451110400 00000100:00100000:0.0:1788179268.095588:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451110400 00000100:00100000:0.0:1788179268.095658:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 53 00000100:00100000:0.0:1788179268.095668:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+14:14444:x1875041451110400:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788179268.095751:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc918381400/0xaa4c98508c49a098 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179268.095769:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc918381400/0xaa4c98508c49a098 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179268.095781:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc918381400/0xaa4c98508c49a098 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179268.096496:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc918380200/0xaa4c98508c49a09f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179268.096512:0:14274:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c49a067 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624be expref: 15 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179268.096527:0:14274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc918380200/0xaa4c98508c49a09f lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179268.096579:0:14274:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c49a067 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746624be expref: 15 pid: 16052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179268.096594:0:14274:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c49a067 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746624be expref: 15 pid: 16052 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179268.096610:0:14274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0f7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14274:1875041472064000:192.168.202.2@tcp:104: 00000100:00100000:0.0:1788179268.096717:0:14274:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc9266da000 going to sleep for 11 seconds 00000100:00100000:0.0:1788179268.109843:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179268.110010:0:14274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0f7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14274:1875041472064000:192.168.202.2@tcp:104: 00010000:00010000:3.0:1788179268.110043:0:14274:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9bc918380200/0xaa4c98508c49a09f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179268.110174:0:14260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451110528 00000100:00100000:1.0:1788179268.110182:0:14260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451110528 00010000:00010000:1.0:1788179268.110223:0:14260:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c49a067 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746624be expref: 16 pid: 16052 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179268.110267:0:14260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 15 00000100:00100000:1.0:1788179268.110277:0:14260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f87a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+16:2357:x1875041451110528:12345-192.168.202.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788179268.110295:0:14260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788179268.110302:0:14260:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c49a067 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746624be expref: 16 pid: 16052 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.110316:0:14260:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c49a067 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746624be expref: 16 pid: 16052 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.110340:0:14260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c49a067 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.2@tcp remote: 0x34c7c424746624be expref: 16 pid: 16052 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.110375:0:14260:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bc920ca7e00) 00010000:00010000:1.0:1788179268.110380:0:14260:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc918380200/0xaa4c98508c49a09f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.110391:0:14260:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc918380200/0xaa4c98508c49a09f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.110398:0:14260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc918380200/0xaa4c98508c49a09f lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.110442:0:14260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788179268.110729:0:14274:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9bc918380200/0xaa4c98508c49a09f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179268.110738:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc918380200/0xaa4c98508c49a09f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179268.110847:0:14260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f87a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+15:2357:x1875041451110528:12345-192.168.202.2@tcp:103:ldlm_bl.0 Request processed in 568us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179268.110889:0:14260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 15 00000001:00080000:0.0:1788179268.110994:0:14274:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1788179268.111154:0:14274:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1788179268.111205:0:14274:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1788179268.111295:0:14274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f879880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14274:1875041472064128:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788179268.111398:0:14274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179268.111435:0:14274:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc926785a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788179268.111710:0:14279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472064128 00000100:00100000:1.0:1788179268.111717:0:14279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472064128 00000100:00100000:1.0:1788179268.111765:0:14279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788179268.111773:0:14279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f87b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14274:x1875041472064128:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788179268.111876:0:14279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f87b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14274:x1875041472064128:12345-0@lo:1000:mdt00_000.0 Request processed in 77us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179268.111883:0:14279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788179268.112780:0:14274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f879880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14274:1875041472064128:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788179268.120437:0:14274:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1788179268.120544:0:14274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14274:1875041472064256:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788179268.121731:0:14274:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179268.121810:0:14274:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc90f7350c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788179268.123308:0:14279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472064256 00000100:00100000:0.0:1788179268.123323:0:14279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472064256 00000100:00100000:0.0:1788179268.123427:0:14279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788179268.123438:0:14279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14274:x1875041472064256:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788179268.123869:0:14279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14274:x1875041472064256:12345-0@lo:1000:mdt00_000.0 Request processed in 414us (2121us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788179268.123878:0:14279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788179268.125267:0:14274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14274:1875041472064256:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788179268.125314:0:14274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc918380200/0xaa4c98508c49a09f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.125338:0:14274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc918380200/0xaa4c98508c49a09f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.125346:0:14274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc918380200/0xaa4c98508c49a09f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.125352:0:14274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc918380200 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179268.125357:0:14274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc918380200/0xaa4c98508c49a09f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.125365:0:14274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc918380200/0xaa4c98508c49a09f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.125383:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bc920ca7e00) 00010000:00010000:1.0:1788179268.125386:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788179268.125391:0:14274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc918380200/0xaa4c98508c49a09f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.125397:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc918380200/0xaa4c98508c49a09f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.125434:0:14274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499ff7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.125441:0:14274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499ff7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.125446:0:14274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499ff7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.125452:0:14274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc91317f800 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179268.125461:0:14274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499ff7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.125468:0:14274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499ff7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.125477:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bc910f79300) 00010000:00010000:1.0:1788179268.125480:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788179268.125487:0:14274:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625600/0xaa4c98508c499ffe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624a2 expref: 18 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.125500:0:14274:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625600/0xaa4c98508c499ffe lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624a2 expref: 18 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.125510:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625600/0xaa4c98508c499ffe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624a2 expref: 18 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.125762:0:14274:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920625600/0xaa4c98508c499ffe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.2@tcp remote: 0x34c7c424746624a2 expref: 18 pid: 14276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179268.125778:0:14274:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc92e0c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14274:1875041472064384:192.168.202.2@tcp:105: 00000100:00100000:3.0:1788179268.128537:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179268.128778:0:14277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451110656 00000100:00100000:2.0:1788179268.128787:0:14277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451110656 00000100:00100000:2.0:1788179268.128845:0:14277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:2.0:1788179268.129013:0:14277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc922129450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+19:14443:x1875041451110656:12345-192.168.202.2@tcp:49:dd.0 00000100:00100000:2.0:1788179268.129149:0:14277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc922129450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+19:14443:x1875041451110656:12345-192.168.202.2@tcp:49:dd.0 Request processed in 140us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179268.131914:0:14274:0:(client.c:2702:ptlrpc_set_wait()) set ffff9bc90f7350c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788179268.131978:0:14274:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc92e0c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14274:1875041472064384:192.168.202.2@tcp:105: 00010000:00010000:1.0:1788179268.132007:0:14274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499ff7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.132018:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc91317f800/0xaa4c98508c499ff7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16052 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.132078:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c49a0a6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.132094:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c49a0a6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.132106:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c49a0a6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.132117:0:14274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c49a0a6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.132124:0:14274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c49a0a6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.132131:0:14274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c49a0a6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.132137:0:14274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92f7cfe00 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179268.132142:0:14274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c49a0a6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.132149:0:14274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c49a0a6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.132160:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bc910f79300) 00010000:00010000:1.0:1788179268.132163:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788179268.132166:0:14274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c49a0a6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.132172:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc92f7cfe00/0xaa4c98508c49a0a6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.132188:0:14274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc918381400/0xaa4c98508c49a098 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.132195:0:14274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc918381400/0xaa4c98508c49a098 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.132202:0:14274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc918381400/0xaa4c98508c49a098 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.132207:0:14274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc918381400 already unused, calling callback (ffffffffc20864f0) 00010000:00010000:1.0:1788179268.132210:0:14274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc918381400/0xaa4c98508c49a098 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.132216:0:14274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc918381400/0xaa4c98508c49a098 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.132224:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9bc910f79300) 00010000:00010000:1.0:1788179268.132226:0:14274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788179268.132229:0:14274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc918381400/0xaa4c98508c49a098 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.132235:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc918381400/0xaa4c98508c49a098 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179268.132461:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+19:14444:x1875041451110400:12345-192.168.202.2@tcp:57:lhsmtool_posix.0 Request processed in 36793us (37100us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1788179268.132472:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 53 00000020:00080000:1.0:1788179268.132479:0:14274:0:(tgt_main.c:811:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788179268.132914:0:14308:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788179268.132920:0:14308:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788179268.132948:0:14308:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788179268.132953:0:14308:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788179268.136307:0:14277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 10 00000100:00100000:0.0:1788179268.156163:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179268.156273:0:14278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451110912 00000100:00100000:2.0:1788179268.156283:0:14278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451110912 00000100:00100000:2.0:1788179268.156346:0:14278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 11 00000100:00100000:2.0:1788179268.156356:0:14278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+18:14444:x1875041451110912:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788179268.157233:0:14278:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788179268.157343:0:14278:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1788179268.157393:0:14278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c49a0ad lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14278 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.157412:0:14278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c49a0ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14278 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.157425:0:14278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c49a0ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14278 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.157434:0:14278:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c49a0ad lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14278 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.157441:0:14278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c49a0ad lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14278 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.157458:0:14278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c49a0ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14278 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.157477:0:14278:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788179268.157579:0:14278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+20:14444:x1875041451110912:12345-192.168.202.2@tcp:35:lhsmtool_posix.0 Request processed in 1221us (1423us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788179268.157588:0:14278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 11 00000020:00080000:2.0:1788179268.157593:0:14278:0:(tgt_main.c:811:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788179268.157771:0:14261:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788179268.157779:0:14261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c49a0ad lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14278 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179268.157787:0:14261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920624c00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:3.0:1788179268.157798:0:14261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c49a0ad lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14278 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179268.157807:0:14261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c49a0ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14278 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179268.157819:0:14261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9bc920ca7e00) 00010000:00010000:3.0:1788179268.157822:0:14261:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788179268.157826:0:14261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c49a0ad lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14278 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179268.157832:0:14261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9bc920624c00/0xaa4c98508c49a0ad lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14278 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179268.157885:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179268.157888:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788179268.157890:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788179268.291318:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788179268.313809:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:3.0:1788179268.313889:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179268.314183:0:14913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451111040 00000100:00100000:0.0:1788179268.314194:0:14913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451111040 00000100:00100000:0.0:1788179268.314254:0:14913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451111168 00000100:00100000:0.0:1788179268.314257:0:14913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451111168 00000100:00100000:0.0:1788179268.314278:0:14913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:0.0:1788179268.314288:0:14913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90703b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+8:2357:x1875041451111040:12345-192.168.202.2@tcp:4:dd.0 00002000:00010000:0.0:1788179268.314345:0:14913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a957342, atime: 0x6a957341, ctime: 0x6a957342, blocks: 0x1 00010000:00010000:0.0:1788179268.314355:0:14913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f8c8ce4/0xaa4c98508c49a0b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179268.314374:0:14913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1788179268.314379:0:14913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788179268.314386:0:14913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f8c8ce4/0xaa4c98508c49a0b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179268.314402:0:14913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f8c8ce4/0xaa4c98508c49a0b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179268.319190:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179268.319341:0:14914:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788179268.319351:0:14914:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788179268.320200:0:14914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451111296 00000100:00100000:3.0:1788179268.320212:0:14914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451111296 00000100:00100000:2.0:1788179268.320721:0:16406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:2.0:1788179268.320733:0:16406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc90703b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:baf94a59-5a83-4c54-8a75-155abe3189eb+10:2356:x1875041451111168:12345-192.168.202.2@tcp:4:dd.0 00010000:00010000:2.0:1788179268.320771:0:16406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c49a0bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.320790:0:16406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179268.320795:0:16406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179268.320801:0:16406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c49a0bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.320815:0:16406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c49a0bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179268.328932:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179268.328981:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179268.329003:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179268.329016:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:1.0:1788179268.329033:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:2.0:1788179268.329099:0:14915:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788179268.329111:0:14915:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1788179268.329478:0:14914:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788179268.329488:0:14914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451111424 00000100:00100000:3.0:1788179268.329497:0:14914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451111424 00000100:00100000:3.0:1788179268.329556:0:14914:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788179268.329563:0:14914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451111552 00000100:00100000:3.0:1788179268.329565:0:14914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451111552 00000100:00100000:3.0:1788179268.329580:0:14914:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788179268.329584:0:14914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451111680 00000100:00100000:3.0:1788179268.329586:0:14914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451111680 00000100:00100000:3.0:1788179268.329597:0:14914:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788179268.329602:0:14914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451111808 00000100:00100000:3.0:1788179268.329612:0:14914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451111808 00000100:00100000:3.0:1788179268.329630:0:14914:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788179268.329645:0:14914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451111936 00000100:00100000:3.0:1788179268.329648:0:14914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451111936 00000100:00100000:2.0:1788179268.331035:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:2.0:1788179268.331052:0:16407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc907039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:baf94a59-5a83-4c54-8a75-155abe3189eb+16:2357:x1875041451111296:12345-192.168.202.2@tcp:4:dd.0 00010000:00010000:2.0:1788179268.331114:0:16407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c49a0c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.331132:0:16407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179268.331136:0:16407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788179268.331144:0:16407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c49a0c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788179268.331157:0:16407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c49a0c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788179268.416295:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:0.0:1788179268.416324:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:1.0:1788179268.416829:0:14913:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:1.0:1788179268.416835:0:14913:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788179266 -> 1788179267 00002000:00010000:1.0:1788179268.416837:0:14913:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788179266 -> 1788179267 00002000:00010000:1.0:1788179268.416839:0:14913:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1788179268.416874:0:14913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f8c8ce4/0xaa4c98508c49a0b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.416887:0:14913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f8c8ce4/0xaa4c98508c49a0b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.416897:0:14913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f8c8ce4/0xaa4c98508c49a0b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.416905:0:14913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc918381800 already unused, calling callback (ffffffffc1644220) 00010000:00010000:1.0:1788179268.416910:0:14913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f8c8ce4/0xaa4c98508c49a0b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.416918:0:14913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f8c8ce4/0xaa4c98508c49a0b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.416939:0:14913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f8c8ce4/0xaa4c98508c49a0b4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.416948:0:14913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f8c8ce4/0xaa4c98508c49a0b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179268.417057:0:14913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90703b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+18:2357:x1875041451111040:12345-192.168.202.2@tcp:4:dd.0 Request processed in 102765us (103254us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1788179268.417073:0:14913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 0 00000100:00100000:1.0:1788179268.417107:0:14913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:1.0:1788179268.417118:0:14913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+17:2357:x1875041451111424:12345-192.168.202.2@tcp:4:dd.0 00010000:00010000:1.0:1788179268.417151:0:14913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0c400f4/0xaa4c98508c49a0c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.417164:0:14913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179268.417169:0:14913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179268.417175:0:14913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0c400f4/0xaa4c98508c49a0c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.417188:0:14913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0c400f4/0xaa4c98508c49a0c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788179268.461163:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:1.0:1788179268.461705:0:16407:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:1.0:1788179268.461712:0:16407:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 6151 00010000:00010000:1.0:1788179268.461728:0:16407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c49a0c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.461742:0:16407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c49a0c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.461751:0:16407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c49a0c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.461771:0:16407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920624c00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:1.0:1788179268.461777:0:16407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c49a0c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.461786:0:16407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c49a0c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.461807:0:16407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c49a0c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.461815:0:16407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd6101e4/0xaa4c98508c49a0c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179268.461936:0:16407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc907039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:baf94a59-5a83-4c54-8a75-155abe3189eb+15:2357:x1875041451111296:12345-192.168.202.2@tcp:4:dd.0 Request processed in 130884us (142751us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788179268.461945:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 2 00000100:00100000:1.0:1788179268.461979:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:1.0:1788179268.461991:0:16407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:baf94a59-5a83-4c54-8a75-155abe3189eb+14:2356:x1875041451111552:12345-192.168.202.2@tcp:4:dd.0 00010000:00010000:1.0:1788179268.462024:0:16407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c08b46/0xaa4c98508c49a0d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.462036:0:16407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179268.462040:0:16407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179268.462046:0:16407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c08b46/0xaa4c98508c49a0d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.462068:0:16407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9c08b46/0xaa4c98508c49a0d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788179268.472024:0:16406:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1788179268.472049:0:16406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c49a0bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179268.472062:0:16406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c49a0bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179268.472072:0:16406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c49a0bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179268.472080:0:16406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc920625c00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:3.0:1788179268.472084:0:16406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c49a0bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179268.472094:0:16406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c49a0bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179268.472114:0:16406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c49a0bb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179268.472122:0:16406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003038eb37/0xaa4c98508c49a0bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179268.472222:0:16406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc90703b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:baf94a59-5a83-4c54-8a75-155abe3189eb+14:2356:x1875041451111168:12345-192.168.202.2@tcp:4:dd.0 Request processed in 151487us (158327us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788179268.472246:0:16406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 1 00000100:00100000:3.0:1788179268.472284:0:16406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 5 00000100:00100000:3.0:1788179268.472295:0:16406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:baf94a59-5a83-4c54-8a75-155abe3189eb+13:2356:x1875041451111680:12345-192.168.202.2@tcp:4:dd.0 00010000:00010000:3.0:1788179268.472328:0:16406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3a24993/0xaa4c98508c49a0d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179268.472340:0:16406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788179268.472344:0:16406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788179268.472351:0:16406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3a24993/0xaa4c98508c49a0d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179268.472363:0:16406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3a24993/0xaa4c98508c49a0d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788179268.506301:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:1.0:1788179268.506698:0:14913:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00010000:00010000:1.0:1788179268.506717:0:14913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0c400f4/0xaa4c98508c49a0c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.506730:0:14913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0c400f4/0xaa4c98508c49a0c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.506739:0:14913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0c400f4/0xaa4c98508c49a0c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.506746:0:14913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92f7ce800 already unused, calling callback (ffffffffc1644220) 00010000:00010000:1.0:1788179268.506751:0:14913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0c400f4/0xaa4c98508c49a0c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.506760:0:14913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0c400f4/0xaa4c98508c49a0c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.506780:0:14913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0c400f4/0xaa4c98508c49a0c9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.506787:0:14913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0c400f4/0xaa4c98508c49a0c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179268.507491:0:14913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+15:2357:x1875041451111424:12345-192.168.202.2@tcp:4:dd.0 Request processed in 90368us (178563us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788179268.507502:0:14913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 3 00000100:00100000:1.0:1788179268.507536:0:14913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 6 00000100:00100000:1.0:1788179268.507556:0:14913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+14:2356:x1875041451111808:12345-192.168.202.2@tcp:4:dd.0 00010000:00010000:1.0:1788179268.507592:0:14913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a590c321/0xaa4c98508c49a0de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.507607:0:14913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179268.507612:0:14913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179268.507620:0:14913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a590c321/0xaa4c98508c49a0de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.507643:0:14913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a590c321/0xaa4c98508c49a0de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788179268.552261:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00000001:00080000:2.0:1788179268.552301:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:1.0:1788179268.552536:0:16407:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:1.0:1788179268.552550:0:16407:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:1.0:1788179268.552564:0:16407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c08b46/0xaa4c98508c49a0d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.552578:0:16407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c08b46/0xaa4c98508c49a0d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.552587:0:16407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9c08b46/0xaa4c98508c49a0d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.552608:0:16407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92f7cf200 already unused, calling callback (ffffffffc1644220) 00010000:00010000:1.0:1788179268.552613:0:16407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c08b46/0xaa4c98508c49a0d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.552622:0:16407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c08b46/0xaa4c98508c49a0d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.552653:0:16407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9c08b46/0xaa4c98508c49a0d0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.552661:0:16407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9c08b46/0xaa4c98508c49a0d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179268.552750:0:16407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:baf94a59-5a83-4c54-8a75-155abe3189eb+12:2356:x1875041451111552:12345-192.168.202.2@tcp:4:dd.0 Request processed in 90758us (223764us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1788179268.552760:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 4 00000100:00100000:1.0:1788179268.552788:0:16407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:1.0:1788179268.552799:0:16407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:baf94a59-5a83-4c54-8a75-155abe3189eb+11:2356:x1875041451111936:12345-192.168.202.2@tcp:4:dd.0 00010000:00010000:1.0:1788179268.552828:0:16407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0c400f4/0xaa4c98508c49a0e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.552839:0:16407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179268.552844:0:16407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788179268.552881:0:16407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0c400f4/0xaa4c98508c49a0e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.552905:0:16407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0c400f4/0xaa4c98508c49a0e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179268.553818:0:16406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3a24993/0xaa4c98508c49a0d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179268.553831:0:16406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3a24993/0xaa4c98508c49a0d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179268.553839:0:16406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3a24993/0xaa4c98508c49a0d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179268.553846:0:16406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc9137b4c00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:3.0:1788179268.553887:0:16406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3a24993/0xaa4c98508c49a0d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179268.553908:0:16406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3a24993/0xaa4c98508c49a0d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179268.553923:0:16406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3a24993/0xaa4c98508c49a0d7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788179268.553931:0:16406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3a24993/0xaa4c98508c49a0d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788179268.554122:0:16406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:baf94a59-5a83-4c54-8a75-155abe3189eb+11:2356:x1875041451111680:12345-192.168.202.2@tcp:4:dd.0 Request processed in 81828us (225114us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788179268.554130:0:16406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 5 00002000:00010000:1.0:1788179268.598612:0:14913:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1788179268.598622:0:14913:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:1.0:1788179268.598693:0:14913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a590c321/0xaa4c98508c49a0de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.598707:0:14913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a590c321/0xaa4c98508c49a0de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.598716:0:14913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a590c321/0xaa4c98508c49a0de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.598723:0:14913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92f7cec00 already unused, calling callback (ffffffffc1644220) 00010000:00010000:1.0:1788179268.598728:0:14913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a590c321/0xaa4c98508c49a0de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.598736:0:14913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a590c321/0xaa4c98508c49a0de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.598756:0:14913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a590c321/0xaa4c98508c49a0de lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788179268.598763:0:14913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a590c321/0xaa4c98508c49a0de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788179268.598912:0:14913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:baf94a59-5a83-4c54-8a75-155abe3189eb+11:2356:x1875041451111808:12345-192.168.202.2@tcp:4:dd.0 Request processed in 91354us (269888us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788179268.598923:0:14913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 6 00000001:00080000:2.0:1788179268.599702:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00000001:00080000:1.0:1788179268.661887:0:6618:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:0.0:1788179268.662282:0:16407:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1788179268.662311:0:16407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0c400f4/0xaa4c98508c49a0e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179268.662325:0:16407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0c400f4/0xaa4c98508c49a0e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179268.662335:0:16407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0c400f4/0xaa4c98508c49a0e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179268.662343:0:16407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9bc92f7ce800 already unused, calling callback (ffffffffc1644220) 00010000:00010000:0.0:1788179268.662349:0:16407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0c400f4/0xaa4c98508c49a0e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179268.662358:0:16407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0c400f4/0xaa4c98508c49a0e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179268.662452:0:16407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0c400f4/0xaa4c98508c49a0e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788179268.662463:0:16407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0c400f4/0xaa4c98508c49a0e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788179268.662579:0:16407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:baf94a59-5a83-4c54-8a75-155abe3189eb+5:2356:x1875041451111936:12345-192.168.202.2@tcp:4:dd.0 Request processed in 109777us (333537us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788179268.662589:0:16407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 7 00000100:00100000:1.0:1788179268.800759:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788179268.800786:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b6a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472064512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788179268.800894:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179268.801019:0:14912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472064512 00000100:00100000:2.0:1788179268.801028:0:14912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472064512 00000100:00100000:2.0:1788179268.801077:0:14912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788179268.801087:0:14912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472064512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788179268.801111:0:14912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3859808256 avail 3849322496 00000100:00100000:2.0:1788179268.801172:0:14912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875041472064512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179268.801180:0:14912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788179268.801258:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1788179268.801264:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9bc9359bb800, transno 8589934595 00000004:00080000:1.0:1788179268.801281:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1788179268.801309:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b6a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1875041472064512:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788179269.184417:0:14308:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788179269.184428:0:14308:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788179269.184466:0:14308:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788179269.184472:0:14308:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788179269.312061:0:15878:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788179270.215057:0:16444:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1788179270.336296:0:14261:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179270.848407:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041472065024:0@lo:400:kworker.0 00000100:00100000:0.0:1788179270.848494:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179270.848557:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788179270.848564:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce136049-9565-40c1-979f-49dcc63d6657:3307:1875041472064640:0@lo:400:kworker.0 00000100:00100000:0.0:1788179270.848593:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788179270.848628:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f87aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875041472065152:0@lo:400:kworker.0 00000100:00100000:0.0:1788179270.848651:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179270.849067:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f87ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472064896:0@lo:400:kworker.0 00000100:00100000:1.0:1788179270.849103:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179270.849123:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788179270.849130:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472064768:0@lo:400:kworker.0 00000100:00100000:1.0:1788179270.849152:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179270.849181:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93f879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875041472065280:0@lo:400:kworker.0 00000100:00100000:1.0:1788179270.849211:0:14908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472064896 00000100:00100000:1.0:1788179270.849218:0:14908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472064896 00000100:00100000:1.0:1788179270.849265:0:14908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472064768 00000100:00100000:1.0:1788179270.849268:0:14908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472064768 00000100:00100000:1.0:1788179270.849283:0:14908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788179270.849292:0:14908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472064896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179270.849342:0:14908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472064896:12345-0@lo:400:kworker.0 Request processed in 51us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179270.849357:0:14908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788179270.849372:0:14908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788179270.849378:0:14908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472064768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179270.849405:0:14908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875041472064768:12345-0@lo:400:kworker.0 Request processed in 27us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179270.849411:0:14908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788179270.849437:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472064640 00000100:00100000:1.0:1788179270.849440:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472064640 00000100:00100000:1.0:1788179270.849463:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788179270.849469:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+19:3307:x1875041472064640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788179270.849497:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce136049-9565-40c1-979f-49dcc63d6657+19:3307:x1875041472064640:12345-0@lo:400:kworker.0 Request processed in 28us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788179270.849503:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788179270.849767:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce136049-9565-40c1-979f-49dcc63d6657:3307:1875041472064640:0@lo:400:kworker.0 00000100:00100000:2.0:1788179270.850000:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788179270.850012:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9bc93b6a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472065408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788179270.850044:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788179270.850087:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472065024 00000100:00100000:2.0:1788179270.850099:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472065024 00000100:00100000:2.0:1788179270.850128:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472065152 00000100:00100000:2.0:1788179270.850132:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472065152 00000100:00100000:2.0:1788179270.850150:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788179270.850165:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f87b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041472065024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179270.850202:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f87b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875041472065024:12345-0@lo:400:kworker.0 Request processed in 46us (1708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179270.850208:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788179270.850222:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788179270.850228:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875041472065152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179270.850256:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875041472065152:12345-0@lo:400:kworker.0 Request processed in 28us (1604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179270.850261:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788179270.850517:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788179270.850533:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788179270.850536:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788179270.850638:0:14912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472065408 00000100:00100000:0.0:1788179270.850643:0:14912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472065408 00000100:00100000:0.0:1788179270.850745:0:14912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788179270.850753:0:14912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93b6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472065408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788179270.850780:0:14912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788179270.850828:0:14912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93b6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875041472065408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179270.850833:0:14912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788179270.850889:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f87aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1875041472065152:0@lo:400:kworker.0 00000100:00100000:0.0:1788179270.850903:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875041472065024:0@lo:400:kworker.0 00000100:00100000:1.0:1788179270.851039:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788179270.851070:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f87ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472064896:0@lo:400:kworker.0 00000100:00100000:1.0:1788179270.851085:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1875041472064768:0@lo:400:kworker.0 00000100:00100000:2.0:1788179270.851286:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93b6a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1875041472065408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788179270.851309:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041472065280 00000100:00100000:2.0:1788179270.851313:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041472065280 00000100:00100000:2.0:1788179270.851354:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788179270.851360:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc92e0c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875041472065280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788179270.851397:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc92e0c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875041472065280:12345-0@lo:400:kworker.0 Request processed in 37us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788179270.851403:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788179270.851556:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9bc93f879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1875041472065280:0@lo:400:kworker.0 00000100:00080000:3.0:1788179270.852398:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788179271.366375:0:14262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788179271.819271:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179271.819308:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179271.819330:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179271.819346:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179271.819366:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179271.819386:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179271.819409:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.2@tcp (source: 12345-192.168.202.2@tcp) 00000100:00100000:0.0:1788179271.819441:0:14908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451112320 00000100:00100000:0.0:1788179271.819450:0:14908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451112320 00000100:00100000:0.0:1788179271.819500:0:14908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451112832 00000100:00100000:0.0:1788179271.819503:0:14908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451112832 00000100:00100000:0.0:1788179271.819515:0:14908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451112448 00000100:00100000:0.0:1788179271.819518:0:14908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451112448 00000100:00100000:0.0:1788179271.819530:0:14908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451112704 00000100:00100000:0.0:1788179271.819532:0:14908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451112704 00000100:00100000:0.0:1788179271.819547:0:14908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:0.0:1788179271.819555:0:14908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+5:2354:x1875041451112320:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179271.819635:0:14908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+5:2354:x1875041451112320:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 80us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179271.819642:0:14908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 20 00000100:00100000:0.0:1788179271.819661:0:14908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:0.0:1788179271.819667:0:14908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173e045c-d692-4828-8fa4-7aaba778738a+5:2354:x1875041451112832:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179271.819688:0:14908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173e045c-d692-4828-8fa4-7aaba778738a+5:2354:x1875041451112832:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 21us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179271.819694:0:14908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 21 00000100:00100000:0.0:1788179271.819703:0:14908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:0.0:1788179271.819709:0:14908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f87bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+5:2354:x1875041451112448:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179271.819725:0:14908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f87bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:baf94a59-5a83-4c54-8a75-155abe3189eb+5:2354:x1875041451112448:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 17us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179271.819731:0:14908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 22 00000100:00100000:0.0:1788179271.819738:0:14908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:0.0:1788179271.819743:0:14908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f87b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173e045c-d692-4828-8fa4-7aaba778738a+5:2354:x1875041451112704:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179271.819757:0:14908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f87b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173e045c-d692-4828-8fa4-7aaba778738a+5:2354:x1875041451112704:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 14us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179271.819768:0:14908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 23 00000100:00100000:0.0:1788179271.819785:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451112576 00000100:00100000:0.0:1788179271.819788:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451112576 00000100:00100000:0.0:1788179271.819810:0:14276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451112192 00000100:00100000:0.0:1788179271.819813:0:14276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451112192 00000100:00100000:0.0:1788179271.819827:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:0.0:1788179271.819833:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f87aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173e045c-d692-4828-8fa4-7aaba778738a+6:2354:x1875041451112576:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179271.819880:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f87aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173e045c-d692-4828-8fa4-7aaba778738a+6:2354:x1875041451112576:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 47us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179271.819886:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 28 00000100:00100000:0.0:1788179271.819897:0:14276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00100000:0.0:1788179271.819902:0:14276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc93f878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+20:2354:x1875041451112192:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:0.0:1788179271.819922:0:14276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc93f878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:baf94a59-5a83-4c54-8a75-155abe3189eb+20:2354:x1875041451112192:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 20us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788179271.819928:0:14276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 29 00000100:00080000:0.0:1788179271.819947:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788179271.819951:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788179271.819953:0:14270:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788179271.823773:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875041451112064 00000100:00100000:3.0:1788179271.823790:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875041451112064 00000100:00100000:3.0:1788179271.823946:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.2@tcp, seq: 122 00000100:00100000:3.0:1788179271.823958:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9bc9375f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+13:2354:x1875041451112064:12345-192.168.202.2@tcp:400:kworker.0 00000100:00100000:3.0:1788179271.824053:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9bc9375f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f7bf92cc-cde0-449b-9fe5-bd0a76f2dfda+13:2354:x1875041451112064:12345-192.168.202.2@tcp:400:kworker.0 Request processed in 98us (4792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788179271.824061:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.2@tcp, seq: 122 Debug log: 29616 lines, 29616 kept, 0 dropped, 0 bad.